-- Logs begin at Thu 2022-08-25 23:52:02 UTC, end at Fri 2022-08-26 01:16:54 UTC. -- Aug 26 00:45:05.548901 dv-cinder-835384-25-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 26 00:45:05.557780 dv-cinder-835384-25-iscsi devstack@n-api.service[112549]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 26 00:45:05.559688 dv-cinder-835384-25-iscsi devstack@n-api.service[112549]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 26 00:45:05 2022] *** Aug 26 00:45:05.559688 dv-cinder-835384-25-iscsi devstack@n-api.service[112549]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 26 00:45:05.559688 dv-cinder-835384-25-iscsi devstack@n-api.service[112549]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 26 00:45:05.559688 dv-cinder-835384-25-iscsi devstack@n-api.service[112549]: nodename: dv-cinder-835384-25-iscsi Aug 26 00:45:05.559688 dv-cinder-835384-25-iscsi devstack@n-api.service[112549]: machine: x86_64 Aug 26 00:45:05.559688 dv-cinder-835384-25-iscsi devstack@n-api.service[112549]: clock source: unix Aug 26 00:45:05.559688 dv-cinder-835384-25-iscsi devstack@n-api.service[112549]: pcre jit disabled Aug 26 00:45:05.559688 dv-cinder-835384-25-iscsi devstack@n-api.service[112549]: detected number of CPU cores: 4 Aug 26 00:45:05.559688 dv-cinder-835384-25-iscsi devstack@n-api.service[112549]: current working directory: / Aug 26 00:45:05.559688 dv-cinder-835384-25-iscsi devstack@n-api.service[112549]: detected binary path: /usr/bin/uwsgi-core Aug 26 00:45:05.559688 dv-cinder-835384-25-iscsi devstack@n-api.service[112549]: your processes number limit is 47680 Aug 26 00:45:05.560548 dv-cinder-835384-25-iscsi devstack@n-api.service[112549]: your memory page size is 4096 bytes Aug 26 00:45:05.560548 dv-cinder-835384-25-iscsi devstack@n-api.service[112549]: detected max file descriptor number: 2048 Aug 26 00:45:05.560548 dv-cinder-835384-25-iscsi devstack@n-api.service[112549]: lock engine: pthread robust mutexes Aug 26 00:45:05.560548 dv-cinder-835384-25-iscsi devstack@n-api.service[112549]: thunder lock: enabled Aug 26 00:45:05.560548 dv-cinder-835384-25-iscsi devstack@n-api.service[112549]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 26 00:45:05.560548 dv-cinder-835384-25-iscsi devstack@n-api.service[112549]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 26 00:45:05.598566 dv-cinder-835384-25-iscsi devstack@n-api.service[112549]: Python main interpreter initialized at 0x561322e4a9c0 Aug 26 00:45:05.598566 dv-cinder-835384-25-iscsi devstack@n-api.service[112549]: python threads support enabled Aug 26 00:45:05.598566 dv-cinder-835384-25-iscsi devstack@n-api.service[112549]: your server socket listen backlog is limited to 100 connections Aug 26 00:45:05.598566 dv-cinder-835384-25-iscsi devstack@n-api.service[112549]: your mercy for graceful operations on workers is 90 seconds Aug 26 00:45:05.598925 dv-cinder-835384-25-iscsi devstack@n-api.service[112549]: mapped 403077 bytes (393 KB) for 2 cores Aug 26 00:45:05.599002 dv-cinder-835384-25-iscsi devstack@n-api.service[112549]: *** Operational MODE: preforking *** Aug 26 00:45:05.599222 dv-cinder-835384-25-iscsi devstack@n-api.service[112549]: *** uWSGI is running in multiple interpreter mode *** Aug 26 00:45:05.599222 dv-cinder-835384-25-iscsi devstack@n-api.service[112549]: spawned uWSGI master process (pid: 112549) Aug 26 00:45:05.599418 dv-cinder-835384-25-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 26 00:45:05.604497 dv-cinder-835384-25-iscsi devstack@n-api.service[112549]: spawned uWSGI worker 1 (pid: 112550, cores: 1) Aug 26 00:45:05.604497 dv-cinder-835384-25-iscsi devstack@n-api.service[112549]: spawned uWSGI worker 2 (pid: 112551, cores: 1) Aug 26 00:45:05.604497 dv-cinder-835384-25-iscsi devstack@n-api.service[112549]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 26 00:45:06.260336 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 26 00:45:06.283236 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 26 00:45:07.355818 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 00:45:07.355818 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: from cryptography.utils import int_from_bytes Aug 26 00:45:07.356503 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 00:45:07.356503 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: from cryptography.utils import int_from_bytes Aug 26 00:45:07.384993 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 00:45:07.384993 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: from cryptography.utils import int_from_bytes Aug 26 00:45:07.385487 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 00:45:07.385487 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: from cryptography.utils import int_from_bytes Aug 26 00:45:09.829087 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 26 00:45:09.829629 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 26 00:45:09.829854 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 26 00:45:09.830004 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 26 00:45:09.830392 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 26 00:45:09.830495 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 26 00:45:09.830592 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 26 00:45:09.830785 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 26 00:45:09.830896 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.831127 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.831219 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 26 00:45:09.831390 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 26 00:45:09.831502 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.831741 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.831838 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.832069 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.832172 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.832376 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.832465 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.832715 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.832815 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.833030 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.833133 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.833342 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.833436 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.833600 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.833683 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.833912 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.834016 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.834231 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835384-25-iscsi {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.834326 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.834528 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.834629 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.834840 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.834939 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.835146 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.835234 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835384-25-iscsi {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.835458 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.835554 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.835760 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.835856 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.836067 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.836162 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.836368 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.836462 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.836702 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.836889 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.837030 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.837337 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.837464 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.837634 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.837831 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.837949 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.838150 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.838258 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.838458 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.838569 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.838767 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.838866 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.839102 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.839204 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.839415 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.839512 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.839728 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.839898 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.840027 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.840132 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.840343 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.840443 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835384-25-iscsi {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.840690 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.840815 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.841562 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.841717 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.841886 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.842013 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835384-25-iscsi {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.842223 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.842379 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.842536 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.842624 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.842850 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.842957 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.843183 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.843327 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.843505 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.843612 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.843811 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.843908 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.844135 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.844232 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.844454 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.844582 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.844798 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.844888 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.845113 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.845209 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.845413 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.845511 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.845717 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.845822 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.846024 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.846112 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.846338 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.846429 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.846642 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.846731 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.846943 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.847033 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.847192 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.847283 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.847494 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.847594 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.847813 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.847902 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.848084 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.848187 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.848392 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.848512 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.848708 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.848813 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.848956 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.849047 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.849313 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.849403 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.849593 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.849695 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.849846 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.849944 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.850164 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.850253 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.850483 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.850574 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.850792 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.850890 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.851095 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.851190 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.851400 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.851490 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.851701 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.851794 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.852008 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.852108 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.852313 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.852402 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.852643 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.852745 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.852949 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.853052 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.853251 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.853340 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.853568 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.853657 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.853884 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.853982 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.854189 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.854286 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.854492 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.854587 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.854829 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.854927 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.855128 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.855217 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.855436 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.855532 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.855750 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.855845 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.856067 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.856164 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.856372 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.856467 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.857237 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.857339 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.857543 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.857662 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.857914 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.858025 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.858219 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.858316 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.858526 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.858619 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.858787 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.858874 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.859087 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.859185 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.859390 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.859486 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.859685 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.859781 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.859987 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.860078 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.860292 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.860387 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.860619 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.860731 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.860919 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.861009 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.861221 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.861311 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.861523 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.861620 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.861823 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.861919 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.862126 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.862227 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.862426 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.862524 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.862726 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.862815 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.863026 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.863121 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.863328 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.863430 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.863626 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.863728 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.863931 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.864020 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.864236 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.864409 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.864558 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.864648 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.864861 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.864962 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.865161 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.865259 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.865462 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.865558 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.865771 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.865867 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.866072 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.866169 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.866372 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.866474 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.866688 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.866785 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.866989 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.867091 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.867288 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.867384 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.867603 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.867701 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.867904 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.868002 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.868206 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.868294 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.868537 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.868629 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.868836 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.868934 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.869136 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.869225 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.869450 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.869550 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.869750 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.869846 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.870048 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.870143 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.870349 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.870439 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.870647 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.870747 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.870944 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.871040 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.871242 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.871337 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.871539 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.871638 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.871838 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.871928 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.872162 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.872298 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.872464 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.872583 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.872787 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.872905 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.873091 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.873204 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.873391 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.873480 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.873691 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.873789 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.874021 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.874117 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.874314 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.874412 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.874618 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.874718 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.874935 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:45:09.875038 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.875271 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.875371 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.875598 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.875741 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.875926 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.876022 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.876242 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.876336 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.876572 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.876664 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.876886 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.876982 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.877210 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.877299 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.877519 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.877618 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.877827 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.877917 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.878134 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.878231 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.878450 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.878565 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.878764 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.878867 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.879073 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.879161 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.879389 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.879488 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.879702 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.879792 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.880014 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.880146 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.880324 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.880447 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.880664 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.880753 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.880983 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.881074 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.881296 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.881399 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.881612 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.881703 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.881947 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.882121 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.882306 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.882454 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.882597 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.882735 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.882895 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.883035 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.883211 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.883352 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.883519 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.883660 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.883827 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.883964 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.884134 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.884271 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.884440 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.884548 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.884773 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.884863 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.885085 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.885178 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.885399 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.885488 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.885709 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.885843 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.886026 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.886124 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.886334 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.886437 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.886641 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.886739 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.886950 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.887042 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.887256 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.887345 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.887563 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.887658 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.887900 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.887998 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.888211 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.888307 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.888542 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.888673 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.888855 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.888946 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.889165 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.889255 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.889478 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.889575 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.889784 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.889873 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.890095 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.890184 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.890403 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.890517 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.890701 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.890791 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.891001 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.891092 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.891302 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.891401 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.891606 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.891694 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.891904 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.891992 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.892207 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.892349 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.892525 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.892677 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.892832 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.892971 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.893151 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.893300 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.893440 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.893576 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.893744 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.893883 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.894034 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.894188 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.894364 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.894502 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.894650 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.894794 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.894939 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.895082 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.895219 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.895362 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.895501 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.895646 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.895814 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.895948 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.896121 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.896259 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.896422 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.896600 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.896764 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.896898 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.897065 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.897210 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.897369 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.897512 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.897667 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.897810 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.897957 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.898095 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.898268 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.898414 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.898574 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.898708 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.898879 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.899013 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.899189 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.899327 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.899494 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.899639 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.899798 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.899950 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.900119 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.900259 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.900431 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.900591 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.900762 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.900901 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.901065 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.901212 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.901388 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.901534 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.901702 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.901843 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.901999 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.902141 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.902277 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.902362 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.902582 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.902692 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.902884 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.902984 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.903184 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.903277 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.904003 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.904112 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.904304 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.904400 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.904627 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.904719 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.904928 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.905027 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.905228 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.905324 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.905527 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.905615 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.905829 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.905927 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.906134 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.906225 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.906687 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.906789 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.906989 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.907080 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.907288 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.907376 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.907597 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.907685 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.907900 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.907991 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.908202 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.908291 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.908569 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.908662 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.908933 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.909035 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.909197 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.909294 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.909506 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.909595 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.909820 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.909910 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.910132 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.910222 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.910440 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.910537 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.910744 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.910833 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.911051 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.911139 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.911364 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.911461 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.911673 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.911762 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.911982 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.912078 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.912301 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.912400 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.912658 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.912749 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.912966 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.913056 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.913282 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.913381 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.913586 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.913676 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.913896 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.913984 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.914230 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.914396 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.914535 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.914623 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.914851 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.914940 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.915166 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.915255 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.915473 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.915570 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.915784 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.915880 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.916089 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.916179 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.916393 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.916588 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.916722 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.916812 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.917026 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.917128 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.917337 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.917427 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.917642 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.917740 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.917947 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.918045 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.918249 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.918337 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.918562 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.918660 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.918865 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.918978 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.919730 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.919835 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.920036 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.920134 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.920352 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.920442 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.920692 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.920793 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.921000 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.921099 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.921314 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.921406 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.921619 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.921709 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.921937 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.922037 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.922246 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.922337 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.922552 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.922645 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.922857 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.922958 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.923158 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.923247 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.923460 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.923553 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.923765 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.923856 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.924070 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.924158 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.924375 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.924495 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.924708 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.924799 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.925010 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.925108 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.925319 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.925407 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.925626 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.925723 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.925927 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.926016 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.926228 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.926320 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.926533 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.926623 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.926839 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.926929 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.927143 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.927239 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.927451 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.927547 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.927769 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.927864 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.928072 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.928175 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.928375 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.928464 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.928722 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.928811 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.929027 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.929133 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.929334 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.929424 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.929655 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.929744 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.929965 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.930114 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.930272 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.930362 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.930578 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.930668 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.930878 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.931014 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.931238 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.931332 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.931524 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.931612 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.931829 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.931927 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.932144 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.932233 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.932451 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.932599 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.932782 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.932917 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.933095 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.933184 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.933405 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.933492 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.933712 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.933802 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.934019 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.934108 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.934326 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.934429 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.934653 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.934781 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.934959 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.935047 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.935267 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.935370 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.935573 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.935661 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.935882 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.935970 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.936184 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.936285 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.936501 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.936607 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.936810 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.936900 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.937124 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.937221 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.937429 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.937688 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.937785 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.938019 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.938122 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.938334 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.938591 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.938681 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.938925 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.939040 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.939240 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.939331 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.939558 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.939657 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.939876 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.939968 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.940216 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.940395 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.940549 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.940653 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.940859 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.940958 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.941164 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.941261 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.941466 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.941564 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.941772 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.941860 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.942073 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.942169 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.942375 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.942472 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.942673 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.942761 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.942975 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.943063 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.943275 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.943375 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.943573 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.943663 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.943873 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.943963 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.944174 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.944263 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.944514 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.944623 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.944800 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.944948 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.945103 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.945192 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.945402 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.945490 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.945707 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.945811 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.946013 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.946109 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.946313 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.946401 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.946612 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.946709 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.946911 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.947002 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.947221 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.947310 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.947526 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.947624 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.947830 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.947920 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.948167 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.948264 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.948489 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.948599 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.948823 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.948912 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.949126 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.949224 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.949447 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.949553 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.949746 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.949836 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.950050 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.950139 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.950384 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.950544 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.950680 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.950769 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.950977 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.951068 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.951277 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.951433 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.951756 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.951872 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.951965 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.952059 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.952177 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.952334 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.952529 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.952676 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.952830 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.952989 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.953125 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.953298 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.953396 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.953605 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.953703 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.953908 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.954007 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.954215 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.954306 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.954516 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.954671 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.954832 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.954923 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.955138 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.955237 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.955435 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.955534 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.955733 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.955822 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.956029 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.956119 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.956336 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.956434 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.956661 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.956752 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.956964 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.957060 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.957264 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.957367 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.957567 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.957655 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.957870 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.957967 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.958170 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.958269 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.958474 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.958596 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.958782 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.958872 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.959084 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.959187 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.959385 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.959514 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.959686 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.959782 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.959987 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.960078 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.960288 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.960377 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.960617 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.960710 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.960930 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.961021 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.961236 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.961333 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.961533 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.961629 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.961837 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.961928 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.962137 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.962226 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.962436 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.962535 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.962735 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.962863 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.963038 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.963128 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.963338 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.963446 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.963634 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.963732 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.963931 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.964020 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.964228 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.964328 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.964548 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.964657 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.964850 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.964941 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.965154 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.965262 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.965449 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.965548 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.965749 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.965838 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.966590 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.966691 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.966932 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.967030 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.967233 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.967323 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.967595 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.967687 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.967902 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.968000 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.968209 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.968297 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.968548 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.968655 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.968859 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.968957 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.969167 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.969256 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.969476 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.969836 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.969958 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.970078 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.970187 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.970303 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.970413 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.970512 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.970675 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.970764 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.970976 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.971075 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.971277 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.971367 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.971593 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.971683 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.971898 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.971996 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.972201 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.972290 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.972527 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.972621 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.972849 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.972992 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.973162 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.973306 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.973463 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.973615 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.973759 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.973907 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.974045 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.974191 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.974338 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.974476 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.974645 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.974780 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.974952 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.975096 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.975260 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.975353 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.975569 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.975661 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.975877 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.975967 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.976184 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.976272 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.976513 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.976620 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.976823 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.976921 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.977128 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.977219 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.977435 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.977527 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.977739 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.977828 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.978042 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.978140 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.978353 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.978443 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.978654 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.978742 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.978958 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.979061 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.979260 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.979357 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.979570 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.979674 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.979873 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.979980 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.980179 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.980303 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.980503 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.980645 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.980815 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.980954 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.981122 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.981257 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.981602 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.982178 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.982403 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.982493 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.982715 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.982802 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.983027 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.983183 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.983337 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.983477 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.983644 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.983748 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.983960 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.984049 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.984276 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.984366 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.984605 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.984711 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.984931 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.985021 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.985267 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.985429 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.985580 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.985721 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.985886 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.986037 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.986176 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.986313 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.986481 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.986618 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.986784 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.986889 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.987107 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.987248 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.987407 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.987550 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.987697 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.987841 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.988003 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.988135 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.988328 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.988467 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.988659 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.988805 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.988984 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.989144 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.989403 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.989541 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.989702 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.989868 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.990016 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.990107 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.990369 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.990467 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.990688 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.990807 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.990993 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.991093 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.991307 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.991399 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.991614 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.991711 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.991936 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.992035 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.992259 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.992348 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.992595 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.992689 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.992909 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.993009 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.993212 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.993309 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.993532 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.993667 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.993846 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.993950 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.994162 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.994253 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.994469 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.994568 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.994794 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.994885 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.995118 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.995219 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.995433 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.995536 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.995756 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.995846 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.996090 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.996186 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.996395 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.996509 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.996733 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.996822 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.997040 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.997150 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.997368 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.997467 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.997669 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.997759 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.997987 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.998077 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.998288 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.998387 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.998595 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.998686 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.998901 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.998991 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.999207 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.999298 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.999507 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.999605 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.999807 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:09.999947 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.000129 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.000218 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.000427 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.000535 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.000757 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.000860 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.001063 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.001154 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.001381 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.001471 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.001683 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.001782 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.001991 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.002080 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.002305 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.002403 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.002609 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.002706 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.002910 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.003008 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.003211 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.003301 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.003513 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.003616 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.003833 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.003921 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.004136 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.004226 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.004442 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.004616 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.004769 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.004867 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.005102 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.005192 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.005406 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.005545 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.005727 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.005825 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.006047 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.006137 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.006363 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.006453 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.006673 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.006762 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.006993 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.007088 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.007297 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.007399 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.007599 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.007691 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.007906 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.008004 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.008207 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.008297 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.008530 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.008634 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.008834 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.008934 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.009139 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.009228 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.009439 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.009528 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.009741 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.009841 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.010046 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.010137 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.010354 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.010459 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.010656 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.010759 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.010959 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.011048 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.011264 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.011353 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.011564 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.011655 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.011867 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.011965 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.012167 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.012256 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.012509 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.012601 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.012842 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.012935 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.013145 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.013242 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.013453 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.013562 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.013769 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.013860 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.014082 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.014181 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.014394 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.014487 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.014706 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.014796 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.015016 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.015115 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.015327 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.015418 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.015637 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.015735 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.015948 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.016049 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.016254 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.016344 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.016587 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.016693 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.016902 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.017002 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.017213 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.017350 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.017524 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.017731 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.017829 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.018058 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.018151 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.018369 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.018460 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.018679 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.018952 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.019053 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.019281 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.019372 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.019587 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.019676 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.019896 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.019988 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.020209 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.020308 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.020535 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.020627 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.020845 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.020938 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.021155 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.021246 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.021465 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.021557 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.021778 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.021871 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.022089 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.022181 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.022409 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.022513 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.022723 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.022813 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.023035 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.023125 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.023348 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.023449 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.023674 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.023780 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.023988 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.024078 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.024290 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.024380 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.024626 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.024732 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.024939 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.025029 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.025249 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.025341 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.025556 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.025660 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.025865 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.025964 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.026176 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.026266 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.026483 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.026573 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.026791 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.026938 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.027096 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.027187 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.027409 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.027506 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.027718 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.027815 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.028027 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.028116 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.028336 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.028974 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.029181 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.029274 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.029493 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.029590 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.029819 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.029908 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.030188 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.030302 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.030469 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.030706 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.030796 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.031023 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.031132 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.031345 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.031689 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.031927 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.032149 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.032250 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.032478 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.032583 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.032825 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.032916 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.033154 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.033253 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.033481 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.033618 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.033790 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.033880 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.034100 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.034198 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.034409 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.034506 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.034712 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.034810 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.035016 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.035115 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.035327 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.035417 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.035626 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.035716 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.035933 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.036031 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.036237 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.036327 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.036578 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.036797 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.036902 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.037143 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.037233 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.037457 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.037546 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.037779 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.038016 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.038109 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.038361 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.038451 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.038680 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.038770 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.039007 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.039097 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.039312 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.039404 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.039617 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.039715 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.039930 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.040020 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.040296 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.040408 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.040565 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.040667 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.040869 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.040963 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.041178 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.041268 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.041486 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.041589 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.041789 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.041879 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.042094 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.042183 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.042394 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.042492 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.042703 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.042792 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.043010 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.043101 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.043314 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.043412 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.043616 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.043751 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.043922 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.044053 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.044275 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.044368 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.044602 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.044698 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.044912 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.045000 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.045215 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.045305 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.045518 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.045607 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.045819 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.045953 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.046124 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.046215 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.046425 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.046514 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.046733 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.046832 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.047036 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.047125 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.047343 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.047440 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.047648 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.047755 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.047959 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.048050 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.048268 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.048399 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.048598 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.048708 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.048913 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.049004 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.049221 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.049311 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.049542 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.049644 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.049851 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.049951 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.050166 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.050255 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.050477 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.050568 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.050801 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.050898 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.051113 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.051329 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.051504 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.051664 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.051764 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.051985 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.052075 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.052321 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.052600 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.052696 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.052941 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.053031 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.053264 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.053355 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.053568 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.053665 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.053894 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.053992 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.054203 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.054302 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.054511 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.054602 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.054819 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.054910 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.055127 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.055224 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.055435 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.055525 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.055744 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.055835 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.056055 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.056166 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.056361 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.056451 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.056694 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.056785 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.057001 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.057135 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.057308 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.057398 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.057627 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.057723 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.057925 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.058023 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.058233 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.058337 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.058543 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.058641 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.058851 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.058942 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.059161 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.059251 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.059472 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.059576 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.060298 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.060387 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.060639 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.060731 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.060949 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.061052 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.061260 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.061350 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.061568 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.061665 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.061873 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.061972 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.062184 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.062274 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.062497 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.062587 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.062809 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.062906 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.063113 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.063204 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.063425 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.063514 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.063755 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.063847 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.064071 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.064169 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.064377 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.064467 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.064749 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.064840 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.065072 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.065161 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.065396 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.065516 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.065707 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.065810 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.066025 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.066130 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.066331 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.066444 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.066655 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.066745 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.066973 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.067063 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.067295 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.067401 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.067606 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.067698 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.067907 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.068004 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.068208 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.068307 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.068531 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.068634 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.068837 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.068939 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.069152 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.069245 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.069458 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.069550 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.069759 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.069849 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.070057 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.070148 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.070366 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.070455 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.070670 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.070779 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.070970 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.071070 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.071271 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.071368 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.071569 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.071666 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.071874 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.071973 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.072170 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.072277 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.072489 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.072603 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.072788 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.072993 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.073087 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.073391 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.074579 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.074698 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.074698 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.074852 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.074934 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.075022 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.075106 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.075197 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.075331 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.075428 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.075513 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.075594 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.075683 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.075780 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.075871 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.075962 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.076045 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.076157 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.076347 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.076441 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.076672 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.076763 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.076983 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.077072 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.077287 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.077393 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.077590 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.077679 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.077911 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.078032 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.078229 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.078371 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.078550 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.078687 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.078831 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.078932 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.079196 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.079292 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.079459 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.079549 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.079767 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.079866 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.080073 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.080164 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.080383 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.080492 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.080719 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.080946 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.081038 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.081130 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.081333 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.081424 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.081643 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.081741 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.081946 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.082043 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.082254 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.082351 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.082565 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.082664 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.082875 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.082966 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.083184 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.083273 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.083489 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.083580 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.083807 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.083905 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.084114 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.084203 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.084420 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.084553 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.084751 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.084842 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.085058 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.085157 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.085363 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.085453 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.085672 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.085761 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.085977 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.086076 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.086283 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.086419 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.086590 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.086679 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.086897 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.086997 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.087207 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.087345 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.087523 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.087613 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.087824 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.087922 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.088132 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.088232 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.088449 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.088559 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.088785 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.088878 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.089107 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.089196 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.089432 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.089529 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.089742 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.089834 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.090052 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.090149 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.090376 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.090475 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.090664 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.090755 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.091439 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 26 00:45:10.091544 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.091862 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.092191 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.092524 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.092839 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.093145 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:45:10.093388 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 26 00:45:10.244321 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: INFO dbcounter [None req-8548ea2f-e8e9-4b21-9f34-455882984c36 None None] Registered counter for database nova_api Aug 26 00:45:10.246189 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: INFO dbcounter [None req-35802b44-920f-40db-8248-b2b2950d7a0f None None] Registered counter for database nova_api Aug 26 00:45:10.265424 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG oslo_db.sqlalchemy.engines [None req-8548ea2f-e8e9-4b21-9f34-455882984c36 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 00:45:10.268701 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG oslo_db.sqlalchemy.engines [None req-35802b44-920f-40db-8248-b2b2950d7a0f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112550) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 00:45:10.272302 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG dbcounter [-] [112551] Writer thread running {{(pid=112551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 00:45:10.275198 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG dbcounter [-] [112550] Writer thread running {{(pid=112550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 00:45:10.328980 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.context [None req-8548ea2f-e8e9-4b21-9f34-455882984c36 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a(cell1) {{(pid=112551) load_cells /opt/stack/nova/nova/context.py:464}} Aug 26 00:45:10.330675 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.context [None req-35802b44-920f-40db-8248-b2b2950d7a0f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a(cell1) {{(pid=112550) load_cells /opt/stack/nova/nova/context.py:464}} Aug 26 00:45:10.332955 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG oslo_concurrency.lockutils [None req-8548ea2f-e8e9-4b21-9f34-455882984c36 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:45:10.333571 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG oslo_concurrency.lockutils [None req-8548ea2f-e8e9-4b21-9f34-455882984c36 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:45:10.334468 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG oslo_concurrency.lockutils [None req-35802b44-920f-40db-8248-b2b2950d7a0f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:45:10.334939 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG oslo_concurrency.lockutils [None req-35802b44-920f-40db-8248-b2b2950d7a0f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:45:10.335147 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG oslo_concurrency.lockutils [None req-8548ea2f-e8e9-4b21-9f34-455882984c36 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:45:10.335863 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG oslo_concurrency.lockutils [None req-8548ea2f-e8e9-4b21-9f34-455882984c36 None None] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:45:10.336306 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG oslo_concurrency.lockutils [None req-8548ea2f-e8e9-4b21-9f34-455882984c36 None None] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:45:10.336488 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG oslo_concurrency.lockutils [None req-35802b44-920f-40db-8248-b2b2950d7a0f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:45:10.337204 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG oslo_concurrency.lockutils [None req-35802b44-920f-40db-8248-b2b2950d7a0f None None] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:45:10.337647 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG oslo_concurrency.lockutils [None req-35802b44-920f-40db-8248-b2b2950d7a0f None None] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:45:10.338289 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG oslo_concurrency.lockutils [None req-8548ea2f-e8e9-4b21-9f34-455882984c36 None None] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:45:10.339593 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG oslo_concurrency.lockutils [None req-35802b44-920f-40db-8248-b2b2950d7a0f None None] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:45:10.340321 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: INFO dbcounter [None req-8548ea2f-e8e9-4b21-9f34-455882984c36 None None] Registered counter for database nova_cell0 Aug 26 00:45:10.342134 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: INFO dbcounter [None req-35802b44-920f-40db-8248-b2b2950d7a0f None None] Registered counter for database nova_cell0 Aug 26 00:45:10.346333 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: INFO dbcounter [None req-8548ea2f-e8e9-4b21-9f34-455882984c36 None None] Registered counter for database nova_cell1 Aug 26 00:45:10.347465 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: INFO dbcounter [None req-35802b44-920f-40db-8248-b2b2950d7a0f None None] Registered counter for database nova_cell1 Aug 26 00:45:10.353772 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG oslo_db.sqlalchemy.engines [None req-8548ea2f-e8e9-4b21-9f34-455882984c36 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 00:45:10.356757 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG oslo_db.sqlalchemy.engines [None req-35802b44-920f-40db-8248-b2b2950d7a0f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112550) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 00:45:10.357292 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG oslo_db.sqlalchemy.engines [None req-35802b44-920f-40db-8248-b2b2950d7a0f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112550) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 00:45:10.358833 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG oslo_db.sqlalchemy.engines [None req-8548ea2f-e8e9-4b21-9f34-455882984c36 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 00:45:10.361769 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG dbcounter [-] [112551] Writer thread running {{(pid=112551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 00:45:10.363375 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG dbcounter [-] [112550] Writer thread running {{(pid=112550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 00:45:10.364857 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG dbcounter [-] [112550] Writer thread running {{(pid=112550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 00:45:10.503028 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG dbcounter [-] [112551] Writer thread running {{(pid=112551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 00:45:10.507278 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: INFO dbcounter [None req-35802b44-920f-40db-8248-b2b2950d7a0f None None] Registered counter for database nova_cell0 Aug 26 00:45:10.511779 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: INFO dbcounter [None req-8548ea2f-e8e9-4b21-9f34-455882984c36 None None] Registered counter for database nova_cell0 Aug 26 00:45:10.516937 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG oslo_db.sqlalchemy.engines [None req-35802b44-920f-40db-8248-b2b2950d7a0f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112550) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 00:45:10.521312 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG dbcounter [-] [112550] Writer thread running {{(pid=112550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 00:45:10.521478 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG oslo_db.sqlalchemy.engines [None req-8548ea2f-e8e9-4b21-9f34-455882984c36 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 00:45:10.525725 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG dbcounter [-] [112551] Writer thread running {{(pid=112551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 00:45:10.924129 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: WARNING keystonemiddleware.auth_token [None req-35802b44-920f-40db-8248-b2b2950d7a0f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 26 00:45:10.931333 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: WARNING keystonemiddleware.auth_token [None req-35802b44-920f-40db-8248-b2b2950d7a0f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 26 00:45:10.952514 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: WARNING keystonemiddleware.auth_token [None req-8548ea2f-e8e9-4b21-9f34-455882984c36 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 26 00:45:10.959848 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: WARNING keystonemiddleware.auth_token [None req-8548ea2f-e8e9-4b21-9f34-455882984c36 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 26 00:45:11.270752 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: WARNING keystonemiddleware.auth_token [None req-35802b44-920f-40db-8248-b2b2950d7a0f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 26 00:45:11.276627 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: WARNING keystonemiddleware.auth_token [None req-35802b44-920f-40db-8248-b2b2950d7a0f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 26 00:45:11.282645 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561322e4a9c0 pid: 112550 (default app) Aug 26 00:45:11.284735 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi [None req-35802b44-920f-40db-8248-b2b2950d7a0f None None] Calling method '>' {{(pid=112550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:45:11.285913 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: INFO nova.api.openstack.requestlog [None req-35802b44-920f-40db-8248-b2b2950d7a0f None None] 10.222.0.59 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001751 Aug 26 00:45:11.286324 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: [pid: 112550|app: 0|req: 1/1] 10.222.0.59 () {50 vars in 788 bytes} [Fri Aug 26 00:45:11 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:45:11.304293 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: WARNING keystonemiddleware.auth_token [None req-8548ea2f-e8e9-4b21-9f34-455882984c36 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 26 00:45:11.310300 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: WARNING keystonemiddleware.auth_token [None req-8548ea2f-e8e9-4b21-9f34-455882984c36 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 26 00:45:11.315535 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561322e4a9c0 pid: 112551 (default app) Aug 26 00:46:32.993222 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi [None req-35802b44-920f-40db-8248-b2b2950d7a0f None None] Calling method '>' {{(pid=112550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:46:32.994137 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: INFO nova.api.openstack.requestlog [None req-35802b44-920f-40db-8248-b2b2950d7a0f None None] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Aug 26 00:46:32.994522 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: [pid: 112550|app: 0|req: 2/2] 10.222.0.59 () {54 vars in 931 bytes} [Fri Aug 26 00:46:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:46:33.011515 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG dbcounter [-] [112551] Writing DB stats nova_api:SELECT=3 {{(pid=112551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:33.012662 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG dbcounter [-] [112551] Writing DB stats nova_cell0:SELECT=3 {{(pid=112551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:33.013501 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG dbcounter [-] [112551] Writing DB stats nova_cell1:SELECT=3 {{(pid=112551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:33.014337 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG dbcounter [-] [112551] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:33.874158 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi [None req-a83017c2-04ca-4d4d-b5b1-7b2e89f43090 admin admin] Calling method '>' {{(pid=112551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:46:33.907526 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: INFO nova.api.openstack.requestlog [None req-a83017c2-04ca-4d4d-b5b1-7b2e89f43090 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.905769 Aug 26 00:46:33.908294 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: [pid: 112551|app: 0|req: 1/3] 10.222.0.59 () {60 vars in 1292 bytes} [Fri Aug 26 00:46:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:46:36.286703 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi [None req-35802b44-920f-40db-8248-b2b2950d7a0f None None] Calling method '>' {{(pid=112550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:46:36.287737 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: INFO nova.api.openstack.requestlog [None req-35802b44-920f-40db-8248-b2b2950d7a0f None None] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Aug 26 00:46:36.288218 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: [pid: 112550|app: 0|req: 3/4] 10.222.0.59 () {54 vars in 931 bytes} [Fri Aug 26 00:46:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:46:36.729130 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi [None req-ac075cdb-cd6e-4068-a85f-cf1baa9655a2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 1, "swap": 0, "os-flavor-access:is_public": true, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "vcpus": 1, "ram": 256}} {{(pid=112551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:46:36.841121 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: INFO nova.api.openstack.requestlog [None req-ac075cdb-cd6e-4068-a85f-cf1baa9655a2 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.546140 Aug 26 00:46:36.841693 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: [pid: 112551|app: 0|req: 2/5] 10.222.0.59 () {64 vars in 1283 bytes} [Fri Aug 26 00:46:36 2022] POST /compute/v2.1/flavors => generated 407 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 00:46:37.076867 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi [None req-dc8fd6a9-123a-4e68-b812-7e6f90adf2fc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:46:37.084258 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG dbcounter [-] [112550] Writing DB stats nova_api:SELECT=3 {{(pid=112550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:37.085411 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG dbcounter [-] [112550] Writing DB stats nova_cell0:SELECT=3 {{(pid=112550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:37.086384 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG dbcounter [-] [112550] Writing DB stats nova_cell1:SELECT=3 {{(pid=112550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:37.087288 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG dbcounter [-] [112550] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:37.232863 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: INFO nova.api.openstack.requestlog [None req-dc8fd6a9-123a-4e68-b812-7e6f90adf2fc admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.382394 Aug 26 00:46:37.233618 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: [pid: 112550|app: 0|req: 4/6] 10.222.0.59 () {64 vars in 1336 bytes} [Fri Aug 26 00:46:36 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:46:39.631752 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi [None req-ac075cdb-cd6e-4068-a85f-cf1baa9655a2 admin admin] Calling method '>' {{(pid=112551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:46:39.632815 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: INFO nova.api.openstack.requestlog [None req-ac075cdb-cd6e-4068-a85f-cf1baa9655a2 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Aug 26 00:46:39.633232 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: [pid: 112551|app: 0|req: 3/7] 10.222.0.59 () {54 vars in 931 bytes} [Fri Aug 26 00:46:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 00:46:40.298335 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi [None req-f23d3a85-9f95-40de-a846-e45fbb3fd209 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "id": "d1", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "disk": 5}} {{(pid=112550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:46:40.446035 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: INFO nova.api.openstack.requestlog [None req-f23d3a85-9f95-40de-a846-e45fbb3fd209 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.805739 Aug 26 00:46:40.451449 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: [pid: 112550|app: 0|req: 5/8] 10.222.0.59 () {64 vars in 1283 bytes} [Fri Aug 26 00:46:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 00:46:40.459241 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi [None req-7bd718f6-b146-4138-8aa7-366c08e27ae7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:46:40.555011 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: INFO nova.api.openstack.requestlog [None req-7bd718f6-b146-4138-8aa7-366c08e27ae7 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.099544 Aug 26 00:46:40.563898 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: [pid: 112551|app: 0|req: 4/9] 10.222.0.59 () {64 vars in 1336 bytes} [Fri Aug 26 00:46:40 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:46:42.893648 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi [None req-f23d3a85-9f95-40de-a846-e45fbb3fd209 admin admin] Calling method '>' {{(pid=112550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:46:42.894655 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: INFO nova.api.openstack.requestlog [None req-f23d3a85-9f95-40de-a846-e45fbb3fd209 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Aug 26 00:46:42.895049 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: [pid: 112550|app: 0|req: 6/10] 10.222.0.59 () {54 vars in 931 bytes} [Fri Aug 26 00:46:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:46:43.297066 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi [None req-12bb5a40-11d8-4817-9335-54621fc64027 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "id": "d2", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 10, "ram": 1024, "name": "ds1G"}} {{(pid=112551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:46:43.358001 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: INFO nova.api.openstack.requestlog [None req-12bb5a40-11d8-4817-9335-54621fc64027 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.456886 Aug 26 00:46:43.358777 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: [pid: 112551|app: 0|req: 5/11] 10.222.0.59 () {64 vars in 1283 bytes} [Fri Aug 26 00:46:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 00:46:43.371217 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi [None req-b97d69b4-509e-422e-ab3a-0cd04ebd97fe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:46:43.442018 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: INFO nova.api.openstack.requestlog [None req-b97d69b4-509e-422e-ab3a-0cd04ebd97fe admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.075184 Aug 26 00:46:43.442616 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: [pid: 112550|app: 0|req: 7/12] 10.222.0.59 () {64 vars in 1336 bytes} [Fri Aug 26 00:46:43 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:46:45.811516 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi [None req-12bb5a40-11d8-4817-9335-54621fc64027 admin admin] Calling method '>' {{(pid=112551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:46:45.815358 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: INFO nova.api.openstack.requestlog [None req-12bb5a40-11d8-4817-9335-54621fc64027 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Aug 26 00:46:45.815358 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: [pid: 112551|app: 0|req: 6/13] 10.222.0.59 () {54 vars in 931 bytes} [Fri Aug 26 00:46:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:46:46.262756 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi [None req-84b9f561-5ca9-42bb-ab99-2eddd536a3d6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 10, "name": "ds2G", "id": "d3", "vcpus": 2}} {{(pid=112550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:46:46.339972 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: INFO nova.api.openstack.requestlog [None req-84b9f561-5ca9-42bb-ab99-2eddd536a3d6 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.520736 Aug 26 00:46:46.340874 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: [pid: 112550|app: 0|req: 8/14] 10.222.0.59 () {64 vars in 1283 bytes} [Fri Aug 26 00:46:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 00:46:46.352964 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi [None req-da4c7d88-02fd-4a46-8e18-c574d8a023a2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:46:46.465842 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: INFO nova.api.openstack.requestlog [None req-da4c7d88-02fd-4a46-8e18-c574d8a023a2 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.116543 Aug 26 00:46:46.466698 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: [pid: 112551|app: 0|req: 7/15] 10.222.0.59 () {64 vars in 1336 bytes} [Fri Aug 26 00:46:46 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:46:48.835971 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi [None req-84b9f561-5ca9-42bb-ab99-2eddd536a3d6 admin admin] Calling method '>' {{(pid=112550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:46:48.837431 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: INFO nova.api.openstack.requestlog [None req-84b9f561-5ca9-42bb-ab99-2eddd536a3d6 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Aug 26 00:46:48.837822 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: [pid: 112550|app: 0|req: 9/16] 10.222.0.59 () {54 vars in 931 bytes} [Fri Aug 26 00:46:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:46:49.271805 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi [None req-990f5ee3-aac2-4d17-8621-d08f2bd2c1cb admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 4096, "id": "d4", "os-flavor-access:is_public": true, "disk": 20, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "swap": 0}} {{(pid=112551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:46:49.392775 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: INFO nova.api.openstack.requestlog [None req-990f5ee3-aac2-4d17-8621-d08f2bd2c1cb admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.547122 Aug 26 00:46:49.393323 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: [pid: 112551|app: 0|req: 8/17] 10.222.0.59 () {64 vars in 1283 bytes} [Fri Aug 26 00:46:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 00:46:49.405594 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi [None req-d01d0330-7234-4291-825e-7f1ac5534e25 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:46:49.500082 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: INFO nova.api.openstack.requestlog [None req-d01d0330-7234-4291-825e-7f1ac5534e25 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.098252 Aug 26 00:46:49.500708 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: [pid: 112550|app: 0|req: 10/18] 10.222.0.59 () {64 vars in 1336 bytes} [Fri Aug 26 00:46:49 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:46:52.225776 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi [None req-990f5ee3-aac2-4d17-8621-d08f2bd2c1cb admin admin] Calling method '>' {{(pid=112551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:46:52.226824 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: INFO nova.api.openstack.requestlog [None req-990f5ee3-aac2-4d17-8621-d08f2bd2c1cb admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Aug 26 00:46:52.227223 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: [pid: 112551|app: 0|req: 9/19] 10.222.0.59 () {54 vars in 931 bytes} [Fri Aug 26 00:46:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:46:52.806801 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi [None req-1885fd2a-29e6-4692-a395-54b6a3eabdfd admin admin] Calling method '>' {{(pid=112550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:46:52.833207 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: INFO nova.api.openstack.requestlog [None req-1885fd2a-29e6-4692-a395-54b6a3eabdfd admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.599054 Aug 26 00:46:52.833745 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: [pid: 112550|app: 0|req: 11/20] 10.222.0.59 () {60 vars in 1292 bytes} [Fri Aug 26 00:46:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 00:46:55.378479 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi [None req-990f5ee3-aac2-4d17-8621-d08f2bd2c1cb admin admin] Calling method '>' {{(pid=112551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:46:55.379547 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: INFO nova.api.openstack.requestlog [None req-990f5ee3-aac2-4d17-8621-d08f2bd2c1cb admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001555 Aug 26 00:46:55.379971 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: [pid: 112551|app: 0|req: 10/21] 10.222.0.59 () {54 vars in 931 bytes} [Fri Aug 26 00:46:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:46:55.822993 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi [None req-ac4393a5-a264-4fdf-962f-6863d090c788 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 512, "name": "m1.tiny", "vcpus": 1, "swap": 0, "id": "1"}} {{(pid=112550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:46:55.935610 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: INFO nova.api.openstack.requestlog [None req-ac4393a5-a264-4fdf-962f-6863d090c788 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.549195 Aug 26 00:46:55.936160 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: [pid: 112550|app: 0|req: 12/22] 10.222.0.59 () {64 vars in 1283 bytes} [Fri Aug 26 00:46:55 2022] POST /compute/v2.1/flavors => generated 402 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 00:46:55.953992 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi [None req-94b4575d-d949-42c7-b720-a06225c0d372 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:46:56.048446 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: INFO nova.api.openstack.requestlog [None req-94b4575d-d949-42c7-b720-a06225c0d372 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103722 Aug 26 00:46:56.049070 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: [pid: 112551|app: 0|req: 11/23] 10.222.0.59 () {64 vars in 1333 bytes} [Fri Aug 26 00:46:55 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:46:58.351669 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi [None req-ac4393a5-a264-4fdf-962f-6863d090c788 admin admin] Calling method '>' {{(pid=112550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:46:58.352733 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: INFO nova.api.openstack.requestlog [None req-ac4393a5-a264-4fdf-962f-6863d090c788 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Aug 26 00:46:58.353396 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: [pid: 112550|app: 0|req: 13/24] 10.222.0.59 () {54 vars in 931 bytes} [Fri Aug 26 00:46:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:46:58.755275 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi [None req-7df31725-895c-4167-bc02-a7893dfd01c2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "name": "m1.small", "disk": 20, "os-flavor-access:is_public": true, "swap": 0, "id": "2"}} {{(pid=112551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:46:58.848161 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: INFO nova.api.openstack.requestlog [None req-7df31725-895c-4167-bc02-a7893dfd01c2 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.487605 Aug 26 00:46:58.848801 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: [pid: 112551|app: 0|req: 12/25] 10.222.0.59 () {64 vars in 1283 bytes} [Fri Aug 26 00:46:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 00:46:58.861505 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi [None req-d6998a17-bd86-41bf-aeb9-a68fe48d6fc8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:46:58.973595 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: INFO nova.api.openstack.requestlog [None req-d6998a17-bd86-41bf-aeb9-a68fe48d6fc8 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.116210 Aug 26 00:46:58.974171 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: [pid: 112550|app: 0|req: 14/26] 10.222.0.59 () {64 vars in 1333 bytes} [Fri Aug 26 00:46:58 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:47:01.309504 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi [None req-7df31725-895c-4167-bc02-a7893dfd01c2 admin admin] Calling method '>' {{(pid=112551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:47:01.310516 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: INFO nova.api.openstack.requestlog [None req-7df31725-895c-4167-bc02-a7893dfd01c2 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Aug 26 00:47:01.310919 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: [pid: 112551|app: 0|req: 13/27] 10.222.0.59 () {54 vars in 931 bytes} [Fri Aug 26 00:47:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:47:01.762290 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi [None req-20f6f401-6a8a-41f6-94fe-b00c73b9ef54 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "name": "m1.medium", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "3", "ram": 4096, "vcpus": 2, "os-flavor-access:is_public": true}} {{(pid=112550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:47:01.862279 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: INFO nova.api.openstack.requestlog [None req-20f6f401-6a8a-41f6-94fe-b00c73b9ef54 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.545316 Aug 26 00:47:01.863041 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: [pid: 112550|app: 0|req: 15/28] 10.222.0.59 () {64 vars in 1283 bytes} [Fri Aug 26 00:47:01 2022] POST /compute/v2.1/flavors => generated 406 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 00:47:01.875699 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi [None req-d217fb75-904e-42c2-b6b1-9e594d6a51f1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:47:01.985782 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: INFO nova.api.openstack.requestlog [None req-d217fb75-904e-42c2-b6b1-9e594d6a51f1 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.113472 Aug 26 00:47:01.986280 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: [pid: 112551|app: 0|req: 14/29] 10.222.0.59 () {64 vars in 1333 bytes} [Fri Aug 26 00:47:01 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:47:04.396549 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi [None req-20f6f401-6a8a-41f6-94fe-b00c73b9ef54 admin admin] Calling method '>' {{(pid=112550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:47:04.397561 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: INFO nova.api.openstack.requestlog [None req-20f6f401-6a8a-41f6-94fe-b00c73b9ef54 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Aug 26 00:47:04.397995 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: [pid: 112550|app: 0|req: 16/30] 10.222.0.59 () {54 vars in 931 bytes} [Fri Aug 26 00:47:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:47:04.854415 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi [None req-373da6c1-c8e2-4f0f-a8c8-c40b28028c35 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "4", "swap": 0, "rxtx_factor": 1.0, "ram": 8192, "name": "m1.large", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80}} {{(pid=112551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:47:04.860454 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG dbcounter [-] [112551] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=112551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:47:04.935459 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: INFO nova.api.openstack.requestlog [None req-373da6c1-c8e2-4f0f-a8c8-c40b28028c35 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.525010 Aug 26 00:47:04.936001 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: [pid: 112551|app: 0|req: 15/31] 10.222.0.59 () {64 vars in 1283 bytes} [Fri Aug 26 00:47:04 2022] POST /compute/v2.1/flavors => generated 405 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 00:47:04.948618 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi [None req-a1928fe5-c621-4e84-a58c-42fda6782281 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:47:05.046317 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: INFO nova.api.openstack.requestlog [None req-a1928fe5-c621-4e84-a58c-42fda6782281 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101830 Aug 26 00:47:05.047055 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: [pid: 112550|app: 0|req: 17/32] 10.222.0.59 () {64 vars in 1333 bytes} [Fri Aug 26 00:47:04 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:47:07.400886 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi [None req-373da6c1-c8e2-4f0f-a8c8-c40b28028c35 admin admin] Calling method '>' {{(pid=112551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:47:07.409439 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: INFO nova.api.openstack.requestlog [None req-373da6c1-c8e2-4f0f-a8c8-c40b28028c35 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.008918 Aug 26 00:47:07.421614 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: [pid: 112551|app: 0|req: 16/33] 10.222.0.59 () {54 vars in 931 bytes} [Fri Aug 26 00:47:07 2022] GET /compute/v2.1 => generated 388 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:47:07.923210 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi [None req-97e9da46-2ad5-4e8a-84db-00d18224d331 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "id": "5", "name": "m1.xlarge", "vcpus": 8, "os-flavor-access:is_public": true}} {{(pid=112550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:47:08.682998 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: INFO nova.api.openstack.requestlog [None req-97e9da46-2ad5-4e8a-84db-00d18224d331 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 1.265391 Aug 26 00:47:08.688904 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: [pid: 112550|app: 0|req: 18/34] 10.222.0.59 () {64 vars in 1283 bytes} [Fri Aug 26 00:47:07 2022] POST /compute/v2.1/flavors => generated 408 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 26 00:47:08.698281 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi [None req-f77f1429-e1ef-4402-b85c-dd3ffc915898 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:47:08.791953 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: INFO nova.api.openstack.requestlog [None req-f77f1429-e1ef-4402-b85c-dd3ffc915898 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.098911 Aug 26 00:47:08.792894 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: [pid: 112551|app: 0|req: 17/35] 10.222.0.59 () {64 vars in 1333 bytes} [Fri Aug 26 00:47:08 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:47:27.009512 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi [None req-97e9da46-2ad5-4e8a-84db-00d18224d331 admin admin] Calling method '>' {{(pid=112550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:47:27.010524 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: INFO nova.api.openstack.requestlog [None req-97e9da46-2ad5-4e8a-84db-00d18224d331 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Aug 26 00:47:27.011297 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: [pid: 112550|app: 0|req: 19/36] 10.222.0.59 () {54 vars in 931 bytes} [Fri Aug 26 00:47:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:47:27.409832 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi [None req-56affe12-84d7-4125-a46d-cc8adf1d46cd admin admin] Calling method '>' {{(pid=112551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:47:27.427996 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: INFO nova.api.openstack.requestlog [None req-56affe12-84d7-4125-a46d-cc8adf1d46cd admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.411081 Aug 26 00:47:27.428540 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: [pid: 112551|app: 0|req: 18/37] 10.222.0.59 () {60 vars in 1292 bytes} [Fri Aug 26 00:47:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:47:28.489754 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi [None req-97e9da46-2ad5-4e8a-84db-00d18224d331 admin admin] Calling method '>' {{(pid=112550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:47:28.490763 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: INFO nova.api.openstack.requestlog [None req-97e9da46-2ad5-4e8a-84db-00d18224d331 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Aug 26 00:47:28.491158 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: [pid: 112550|app: 0|req: 20/38] 10.222.0.59 () {56 vars in 1074 bytes} [Fri Aug 26 00:47:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:47:29.027048 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi [None req-15bc0f60-4919-4f28-bb7e-32034b0d2b5f admin admin] Calling method '>' {{(pid=112551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:47:29.033083 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: INFO nova.api.openstack.wsgi [None req-15bc0f60-4919-4f28-bb7e-32034b0d2b5f admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 26 00:47:29.036357 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi [None req-15bc0f60-4919-4f28-bb7e-32034b0d2b5f admin admin] Request method failure captured: Aug 26 00:47:29.036357 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 26 00:47:29.036357 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: Accept: application/json Aug 26 00:47:29.036357 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: Accept-Encoding: gzip, deflate Aug 26 00:47:29.036357 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: Connection: keep-alive Aug 26 00:47:29.036357 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: Content-Length: 0 Aug 26 00:47:29.036357 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: Host: 10.222.0.59 Aug 26 00:47:29.036357 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: Openstack-Api-Version: compute 2.90 Aug 26 00:47:29.036357 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: Openstack-System-Scope: None Aug 26 00:47:29.036357 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: User-Agent: python-novaclient Aug 26 00:47:29.036357 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: X-Auth-Token: gAAAAABjCBggyePxQSr_LLY_8utDo73Pa2GHkfRyoFceJLH7xNGxnA5Rr5Yr7GfKkrAy4Zlx6AmXR1r3l3iDq5qL-6NSiYL1e4-k8SdjdTe76ArPBIAAdL0v6y4gTUAzShuU3bQceJ9Jvfsr0pN6WClvigavvVo_C0wa9fpL_mLlSVOTKqXm5WE Aug 26 00:47:29.036357 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: X-Domain-Id: None Aug 26 00:47:29.036357 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: X-Domain-Name: None Aug 26 00:47:29.036357 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: X-Identity-Status: Confirmed Aug 26 00:47:29.036357 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: X-Is-Admin-Project: True Aug 26 00:47:29.036357 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: X-Openstack-Nova-Api-Version: 2.90 Aug 26 00:47:29.036357 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: X-Project-Domain-Id: default Aug 26 00:47:29.036357 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: X-Project-Domain-Name: Default Aug 26 00:47:29.036357 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: X-Project-Id: 86ade54a72a44599b7a6313f909a3551 Aug 26 00:47:29.036357 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: X-Project-Name: admin Aug 26 00:47:29.036357 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: X-Role: reader,member,admin Aug 26 00:47:29.036357 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: X-Roles: reader,member,admin Aug 26 00:47:29.038180 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_86ade54a72a44599b7a6313f909a3551"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/86ade54a72a44599b7a6313f909a3551"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/86ade54a72a44599b7a6313f909a3551"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/86ade54a72a44599b7a6313f909a3551"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 00:47:29.038180 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: X-Tenant: admin Aug 26 00:47:29.038180 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: X-Tenant-Id: 86ade54a72a44599b7a6313f909a3551 Aug 26 00:47:29.038180 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: X-Tenant-Name: admin Aug 26 00:47:29.038180 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: X-User: admin Aug 26 00:47:29.038180 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: X-User-Domain-Id: default Aug 26 00:47:29.038180 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: X-User-Domain-Name: Default Aug 26 00:47:29.038180 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: X-User-Id: 795669ccac0f433b900784c76b5b0142 Aug 26 00:47:29.038180 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: X-User-Name: admin Aug 26 00:47:29.038180 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: method: > Aug 26 00:47:29.038180 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: exception: Flavor 42 could not be found. Aug 26 00:47:29.038180 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: action_args: {'id': '42'} Aug 26 00:47:29.038180 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: {{(pid=112551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 00:47:29.038180 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:47:29.039298 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 26 00:47:29.039298 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 26 00:47:29.039298 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 26 00:47:29.039298 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 26 00:47:29.039298 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 26 00:47:29.039298 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 26 00:47:29.039298 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 26 00:47:29.039298 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 26 00:47:29.039298 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 26 00:47:29.039298 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 00:47:29.039298 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 26 00:47:29.039298 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 26 00:47:29.039298 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 26 00:47:29.039298 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi Aug 26 00:47:29.039298 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 00:47:29.039298 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi Aug 26 00:47:29.039298 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:47:29.039298 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 00:47:29.039298 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 00:47:29.040699 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 00:47:29.040699 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 00:47:29.040699 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 00:47:29.040699 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 00:47:29.040699 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 26 00:47:29.040699 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 26 00:47:29.040699 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 26 00:47:29.040699 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi Aug 26 00:47:29.040699 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 00:47:29.040699 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi Aug 26 00:47:29.040699 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:47:29.040699 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 00:47:29.040699 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 00:47:29.040699 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 00:47:29.040699 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 00:47:29.040699 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 26 00:47:29.040699 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi Aug 26 00:47:29.040699 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi [None req-15bc0f60-4919-4f28-bb7e-32034b0d2b5f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 00:47:29.042028 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: INFO nova.api.openstack.requestlog [None req-15bc0f60-4919-4f28-bb7e-32034b0d2b5f admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.405656 Aug 26 00:47:29.042028 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: [pid: 112551|app: 0|req: 19/39] 10.222.0.59 () {60 vars in 1190 bytes} [Fri Aug 26 00:47:28 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 407 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 26 00:47:29.047685 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi [None req-c542743c-0649-46ae-8866-d07833ece682 admin admin] Calling method '>' {{(pid=112550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:47:29.052061 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG dbcounter [-] [112550] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=112550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:47:29.070569 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: INFO nova.api.openstack.requestlog [None req-c542743c-0649-46ae-8866-d07833ece682 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026593 Aug 26 00:47:29.071128 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: [pid: 112550|app: 0|req: 21/40] 10.222.0.59 () {60 vars in 1210 bytes} [Fri Aug 26 00:47:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:47:29.082577 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi [None req-9ee38377-25f7-495d-a739-4464ae749e68 admin admin] Calling method '>' {{(pid=112551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:47:29.108211 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: INFO nova.api.openstack.requestlog [None req-9ee38377-25f7-495d-a739-4464ae749e68 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.030056 Aug 26 00:47:29.108799 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: [pid: 112551|app: 0|req: 20/41] 10.222.0.59 () {60 vars in 1210 bytes} [Fri Aug 26 00:47:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:47:29.118524 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi [None req-3199939e-ae13-4c33-a3f1-87e480b15387 admin admin] Calling method '>' {{(pid=112550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:47:29.124631 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: INFO nova.api.openstack.wsgi [None req-3199939e-ae13-4c33-a3f1-87e480b15387 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 26 00:47:29.128010 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi [None req-3199939e-ae13-4c33-a3f1-87e480b15387 admin admin] Request method failure captured: Aug 26 00:47:29.128010 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 26 00:47:29.128010 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: Accept: application/json Aug 26 00:47:29.128010 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: Accept-Encoding: gzip, deflate Aug 26 00:47:29.128010 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: Connection: keep-alive Aug 26 00:47:29.128010 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: Content-Length: 0 Aug 26 00:47:29.128010 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: Host: 10.222.0.59 Aug 26 00:47:29.128010 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: Openstack-Api-Version: compute 2.90 Aug 26 00:47:29.128010 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: Openstack-System-Scope: None Aug 26 00:47:29.128010 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: User-Agent: python-novaclient Aug 26 00:47:29.128010 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: X-Auth-Token: gAAAAABjCBggyePxQSr_LLY_8utDo73Pa2GHkfRyoFceJLH7xNGxnA5Rr5Yr7GfKkrAy4Zlx6AmXR1r3l3iDq5qL-6NSiYL1e4-k8SdjdTe76ArPBIAAdL0v6y4gTUAzShuU3bQceJ9Jvfsr0pN6WClvigavvVo_C0wa9fpL_mLlSVOTKqXm5WE Aug 26 00:47:29.128010 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: X-Domain-Id: None Aug 26 00:47:29.128010 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: X-Domain-Name: None Aug 26 00:47:29.128010 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: X-Identity-Status: Confirmed Aug 26 00:47:29.128010 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: X-Is-Admin-Project: True Aug 26 00:47:29.128010 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: X-Openstack-Nova-Api-Version: 2.90 Aug 26 00:47:29.128010 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: X-Project-Domain-Id: default Aug 26 00:47:29.128010 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: X-Project-Domain-Name: Default Aug 26 00:47:29.128010 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: X-Project-Id: 86ade54a72a44599b7a6313f909a3551 Aug 26 00:47:29.128010 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: X-Project-Name: admin Aug 26 00:47:29.128010 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: X-Role: reader,member,admin Aug 26 00:47:29.128010 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: X-Roles: reader,member,admin Aug 26 00:47:29.129706 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_86ade54a72a44599b7a6313f909a3551"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/86ade54a72a44599b7a6313f909a3551"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/86ade54a72a44599b7a6313f909a3551"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/86ade54a72a44599b7a6313f909a3551"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 00:47:29.129706 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: X-Tenant: admin Aug 26 00:47:29.129706 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: X-Tenant-Id: 86ade54a72a44599b7a6313f909a3551 Aug 26 00:47:29.129706 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: X-Tenant-Name: admin Aug 26 00:47:29.129706 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: X-User: admin Aug 26 00:47:29.129706 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: X-User-Domain-Id: default Aug 26 00:47:29.129706 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: X-User-Domain-Name: Default Aug 26 00:47:29.129706 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: X-User-Id: 795669ccac0f433b900784c76b5b0142 Aug 26 00:47:29.129706 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: X-User-Name: admin Aug 26 00:47:29.129706 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: method: > Aug 26 00:47:29.129706 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: exception: Flavor 42 could not be found. Aug 26 00:47:29.129706 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: action_args: {'id': '42'} Aug 26 00:47:29.129706 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: {{(pid=112550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 00:47:29.129706 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:47:29.130728 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 26 00:47:29.130728 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 26 00:47:29.130728 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 26 00:47:29.130728 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 26 00:47:29.130728 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 26 00:47:29.130728 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 26 00:47:29.130728 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 26 00:47:29.130728 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 26 00:47:29.130728 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 26 00:47:29.130728 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 00:47:29.130728 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 26 00:47:29.130728 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 26 00:47:29.130728 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 26 00:47:29.130728 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi Aug 26 00:47:29.130728 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 00:47:29.130728 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi Aug 26 00:47:29.130728 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:47:29.130728 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 00:47:29.130728 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 00:47:29.132075 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 00:47:29.132075 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 00:47:29.132075 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 00:47:29.132075 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 00:47:29.132075 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 26 00:47:29.132075 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 26 00:47:29.132075 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 26 00:47:29.132075 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi Aug 26 00:47:29.132075 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 00:47:29.132075 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi Aug 26 00:47:29.132075 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:47:29.132075 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 00:47:29.132075 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 00:47:29.132075 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 00:47:29.132075 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 00:47:29.132075 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 26 00:47:29.132075 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi Aug 26 00:47:29.132075 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi [None req-3199939e-ae13-4c33-a3f1-87e480b15387 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 00:47:29.135992 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: INFO nova.api.openstack.requestlog [None req-3199939e-ae13-4c33-a3f1-87e480b15387 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014578 Aug 26 00:47:29.135992 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: [pid: 112550|app: 0|req: 22/42] 10.222.0.59 () {60 vars in 1190 bytes} [Fri Aug 26 00:47:29 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 26 00:47:30.085929 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi [None req-9ee38377-25f7-495d-a739-4464ae749e68 admin admin] Calling method '>' {{(pid=112551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:47:30.086942 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: INFO nova.api.openstack.requestlog [None req-9ee38377-25f7-495d-a739-4464ae749e68 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Aug 26 00:47:30.087331 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: [pid: 112551|app: 0|req: 21/43] 10.222.0.59 () {56 vars in 1074 bytes} [Fri Aug 26 00:47:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:47:30.608879 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi [None req-9ba967da-5a15-49be-ad8a-e3d9451ee849 admin admin] Calling method '>' {{(pid=112550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:47:30.614401 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: INFO nova.api.openstack.wsgi [None req-9ba967da-5a15-49be-ad8a-e3d9451ee849 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 26 00:47:30.615926 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi [None req-9ba967da-5a15-49be-ad8a-e3d9451ee849 admin admin] Request method failure captured: Aug 26 00:47:30.615926 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 26 00:47:30.615926 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: Accept: application/json Aug 26 00:47:30.615926 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: Accept-Encoding: gzip, deflate Aug 26 00:47:30.615926 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: Connection: keep-alive Aug 26 00:47:30.615926 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: Content-Length: 0 Aug 26 00:47:30.615926 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: Host: 10.222.0.59 Aug 26 00:47:30.615926 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: Openstack-Api-Version: compute 2.90 Aug 26 00:47:30.615926 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: Openstack-System-Scope: None Aug 26 00:47:30.615926 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: User-Agent: python-novaclient Aug 26 00:47:30.615926 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: X-Auth-Token: gAAAAABjCBghHNM8fxqmeVqjgrzcrTC4tT9oD5iaRCk7UB2j1qOC7HJG7RwXP5PiHV2Fe3dTGnsWLo2tryaIsatK2y6k4bepgf6HuwXOncjmHikQ4JrN1iW_kkZC5RWTmhtZ0Ldtp1Da9XqsHgnmOsLqrgOd1FHHX11WfZ_mmy-YACJlwvuAaeI Aug 26 00:47:30.615926 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: X-Domain-Id: None Aug 26 00:47:30.615926 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: X-Domain-Name: None Aug 26 00:47:30.615926 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: X-Identity-Status: Confirmed Aug 26 00:47:30.615926 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: X-Is-Admin-Project: True Aug 26 00:47:30.615926 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: X-Openstack-Nova-Api-Version: 2.90 Aug 26 00:47:30.615926 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: X-Project-Domain-Id: default Aug 26 00:47:30.615926 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: X-Project-Domain-Name: Default Aug 26 00:47:30.615926 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: X-Project-Id: 86ade54a72a44599b7a6313f909a3551 Aug 26 00:47:30.615926 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: X-Project-Name: admin Aug 26 00:47:30.615926 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: X-Role: reader,member,admin Aug 26 00:47:30.615926 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: X-Roles: reader,member,admin Aug 26 00:47:30.617570 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_86ade54a72a44599b7a6313f909a3551"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/86ade54a72a44599b7a6313f909a3551"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/86ade54a72a44599b7a6313f909a3551"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/86ade54a72a44599b7a6313f909a3551"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 00:47:30.617570 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: X-Tenant: admin Aug 26 00:47:30.617570 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: X-Tenant-Id: 86ade54a72a44599b7a6313f909a3551 Aug 26 00:47:30.617570 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: X-Tenant-Name: admin Aug 26 00:47:30.617570 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: X-User: admin Aug 26 00:47:30.617570 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: X-User-Domain-Id: default Aug 26 00:47:30.617570 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: X-User-Domain-Name: Default Aug 26 00:47:30.617570 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: X-User-Id: 795669ccac0f433b900784c76b5b0142 Aug 26 00:47:30.617570 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: X-User-Name: admin Aug 26 00:47:30.617570 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: method: > Aug 26 00:47:30.617570 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: exception: Flavor 84 could not be found. Aug 26 00:47:30.617570 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: action_args: {'id': '84'} Aug 26 00:47:30.617570 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: {{(pid=112550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 00:47:30.617570 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:47:30.618605 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 26 00:47:30.618605 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 26 00:47:30.618605 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 26 00:47:30.618605 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 26 00:47:30.618605 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 26 00:47:30.618605 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 26 00:47:30.618605 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 26 00:47:30.618605 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 26 00:47:30.618605 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 26 00:47:30.618605 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 00:47:30.618605 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 26 00:47:30.618605 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 26 00:47:30.618605 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 26 00:47:30.618605 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi Aug 26 00:47:30.618605 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 00:47:30.618605 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi Aug 26 00:47:30.618605 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:47:30.618605 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 00:47:30.618605 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 00:47:30.619964 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 00:47:30.619964 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 00:47:30.619964 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 00:47:30.619964 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 00:47:30.619964 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 26 00:47:30.619964 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 26 00:47:30.619964 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 26 00:47:30.619964 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi Aug 26 00:47:30.619964 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 00:47:30.619964 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi Aug 26 00:47:30.619964 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:47:30.619964 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 00:47:30.619964 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 00:47:30.619964 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 00:47:30.619964 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 00:47:30.619964 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 26 00:47:30.619964 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi Aug 26 00:47:30.619964 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi [None req-9ba967da-5a15-49be-ad8a-e3d9451ee849 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 00:47:30.621256 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: INFO nova.api.openstack.requestlog [None req-9ba967da-5a15-49be-ad8a-e3d9451ee849 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.391538 Aug 26 00:47:30.621256 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: [pid: 112550|app: 0|req: 23/44] 10.222.0.59 () {60 vars in 1190 bytes} [Fri Aug 26 00:47:30 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 26 00:47:30.627681 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi [None req-e0d71993-7675-4395-bf02-a4146a3abc66 admin admin] Calling method '>' {{(pid=112551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:47:30.644746 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: INFO nova.api.openstack.requestlog [None req-e0d71993-7675-4395-bf02-a4146a3abc66 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020659 Aug 26 00:47:30.647123 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: [pid: 112551|app: 0|req: 22/45] 10.222.0.59 () {60 vars in 1210 bytes} [Fri Aug 26 00:47:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:47:30.655655 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi [None req-d473891b-e8e2-4345-ba80-3fce843e7e40 admin admin] Calling method '>' {{(pid=112550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:47:30.672822 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: INFO nova.api.openstack.requestlog [None req-d473891b-e8e2-4345-ba80-3fce843e7e40 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020693 Aug 26 00:47:30.673345 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: [pid: 112550|app: 0|req: 24/46] 10.222.0.59 () {60 vars in 1210 bytes} [Fri Aug 26 00:47:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:47:30.682589 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi [None req-0eee4529-834e-4fbf-9741-3618478fdf02 admin admin] Calling method '>' {{(pid=112551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:47:30.687852 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: INFO nova.api.openstack.wsgi [None req-0eee4529-834e-4fbf-9741-3618478fdf02 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 26 00:47:30.689382 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi [None req-0eee4529-834e-4fbf-9741-3618478fdf02 admin admin] Request method failure captured: Aug 26 00:47:30.689382 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 26 00:47:30.689382 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: Accept: application/json Aug 26 00:47:30.689382 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: Accept-Encoding: gzip, deflate Aug 26 00:47:30.689382 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: Connection: keep-alive Aug 26 00:47:30.689382 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: Content-Length: 0 Aug 26 00:47:30.689382 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: Host: 10.222.0.59 Aug 26 00:47:30.689382 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: Openstack-Api-Version: compute 2.90 Aug 26 00:47:30.689382 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: Openstack-System-Scope: None Aug 26 00:47:30.689382 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: User-Agent: python-novaclient Aug 26 00:47:30.689382 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: X-Auth-Token: gAAAAABjCBghHNM8fxqmeVqjgrzcrTC4tT9oD5iaRCk7UB2j1qOC7HJG7RwXP5PiHV2Fe3dTGnsWLo2tryaIsatK2y6k4bepgf6HuwXOncjmHikQ4JrN1iW_kkZC5RWTmhtZ0Ldtp1Da9XqsHgnmOsLqrgOd1FHHX11WfZ_mmy-YACJlwvuAaeI Aug 26 00:47:30.689382 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: X-Domain-Id: None Aug 26 00:47:30.689382 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: X-Domain-Name: None Aug 26 00:47:30.689382 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: X-Identity-Status: Confirmed Aug 26 00:47:30.689382 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: X-Is-Admin-Project: True Aug 26 00:47:30.689382 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: X-Openstack-Nova-Api-Version: 2.90 Aug 26 00:47:30.689382 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: X-Project-Domain-Id: default Aug 26 00:47:30.689382 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: X-Project-Domain-Name: Default Aug 26 00:47:30.689382 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: X-Project-Id: 86ade54a72a44599b7a6313f909a3551 Aug 26 00:47:30.689382 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: X-Project-Name: admin Aug 26 00:47:30.689382 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: X-Role: reader,member,admin Aug 26 00:47:30.689382 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: X-Roles: reader,member,admin Aug 26 00:47:30.690840 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_86ade54a72a44599b7a6313f909a3551"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/86ade54a72a44599b7a6313f909a3551"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/86ade54a72a44599b7a6313f909a3551"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/86ade54a72a44599b7a6313f909a3551"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 00:47:30.690840 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: X-Tenant: admin Aug 26 00:47:30.690840 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: X-Tenant-Id: 86ade54a72a44599b7a6313f909a3551 Aug 26 00:47:30.690840 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: X-Tenant-Name: admin Aug 26 00:47:30.690840 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: X-User: admin Aug 26 00:47:30.690840 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: X-User-Domain-Id: default Aug 26 00:47:30.690840 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: X-User-Domain-Name: Default Aug 26 00:47:30.690840 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: X-User-Id: 795669ccac0f433b900784c76b5b0142 Aug 26 00:47:30.690840 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: X-User-Name: admin Aug 26 00:47:30.690840 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: method: > Aug 26 00:47:30.690840 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: exception: Flavor 84 could not be found. Aug 26 00:47:30.690840 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: action_args: {'id': '84'} Aug 26 00:47:30.690840 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: {{(pid=112551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 00:47:30.690840 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:47:30.691702 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 26 00:47:30.691702 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 26 00:47:30.691702 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 26 00:47:30.691702 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 26 00:47:30.691702 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 26 00:47:30.691702 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 26 00:47:30.691702 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 26 00:47:30.691702 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 26 00:47:30.691702 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 26 00:47:30.691702 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 00:47:30.691702 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 26 00:47:30.691702 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 26 00:47:30.691702 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 26 00:47:30.691702 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi Aug 26 00:47:30.691702 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 00:47:30.691702 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi Aug 26 00:47:30.691702 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:47:30.691702 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 00:47:30.691702 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 00:47:30.693106 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 00:47:30.693106 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 00:47:30.693106 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 00:47:30.693106 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 00:47:30.693106 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 26 00:47:30.693106 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 26 00:47:30.693106 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 26 00:47:30.693106 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi Aug 26 00:47:30.693106 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 00:47:30.693106 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi Aug 26 00:47:30.693106 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:47:30.693106 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 00:47:30.693106 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 00:47:30.693106 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 00:47:30.693106 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 00:47:30.693106 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 26 00:47:30.693106 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi Aug 26 00:47:30.693106 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi [None req-0eee4529-834e-4fbf-9741-3618478fdf02 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 00:47:30.694362 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: INFO nova.api.openstack.requestlog [None req-0eee4529-834e-4fbf-9741-3618478fdf02 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011678 Aug 26 00:47:30.694362 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: [pid: 112551|app: 0|req: 23/47] 10.222.0.59 () {60 vars in 1190 bytes} [Fri Aug 26 00:47:30 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 26 00:47:31.650732 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi [None req-d473891b-e8e2-4345-ba80-3fce843e7e40 admin admin] Calling method '>' {{(pid=112550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:47:31.651748 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: INFO nova.api.openstack.requestlog [None req-d473891b-e8e2-4345-ba80-3fce843e7e40 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001947 Aug 26 00:47:31.652122 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: [pid: 112550|app: 0|req: 25/48] 10.222.0.59 () {56 vars in 1074 bytes} [Fri Aug 26 00:47:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:47:32.164807 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi [None req-15796afb-f510-449e-9966-7df141b259e1 admin admin] Calling method '>' {{(pid=112551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:47:32.170438 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: INFO nova.api.openstack.wsgi [None req-15796afb-f510-449e-9966-7df141b259e1 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 26 00:47:32.171930 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi [None req-15796afb-f510-449e-9966-7df141b259e1 admin admin] Request method failure captured: Aug 26 00:47:32.171930 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 26 00:47:32.171930 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: Accept: application/json Aug 26 00:47:32.171930 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: Accept-Encoding: gzip, deflate Aug 26 00:47:32.171930 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: Connection: keep-alive Aug 26 00:47:32.171930 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: Content-Length: 0 Aug 26 00:47:32.171930 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: Host: 10.222.0.59 Aug 26 00:47:32.171930 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: Openstack-Api-Version: compute 2.90 Aug 26 00:47:32.171930 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: Openstack-System-Scope: None Aug 26 00:47:32.171930 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: User-Agent: python-novaclient Aug 26 00:47:32.171930 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: X-Auth-Token: gAAAAABjCBgjtkmy0EI4TmVVO_aF2i1Ynw6dce3miCbPU28GcuN14uJzKdpvdRoyC2yqFIoz2ssIP2WV6aqiJOTPCKWC7hWDdZqTGyuJ5TO7amokVHqoYMK_hP-a5jEuI0tnij9DwYjFzORpwdDDrm9B14WsSuSskHC6tyJuq-kH_5m3m-HeGmU Aug 26 00:47:32.171930 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: X-Domain-Id: None Aug 26 00:47:32.171930 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: X-Domain-Name: None Aug 26 00:47:32.171930 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: X-Identity-Status: Confirmed Aug 26 00:47:32.171930 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: X-Is-Admin-Project: True Aug 26 00:47:32.171930 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: X-Openstack-Nova-Api-Version: 2.90 Aug 26 00:47:32.171930 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: X-Project-Domain-Id: default Aug 26 00:47:32.171930 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: X-Project-Domain-Name: Default Aug 26 00:47:32.171930 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: X-Project-Id: 86ade54a72a44599b7a6313f909a3551 Aug 26 00:47:32.171930 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: X-Project-Name: admin Aug 26 00:47:32.171930 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: X-Role: reader,member,admin Aug 26 00:47:32.171930 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: X-Roles: reader,member,admin Aug 26 00:47:32.173372 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_86ade54a72a44599b7a6313f909a3551"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/86ade54a72a44599b7a6313f909a3551"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/86ade54a72a44599b7a6313f909a3551"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/86ade54a72a44599b7a6313f909a3551"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 00:47:32.173372 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: X-Tenant: admin Aug 26 00:47:32.173372 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: X-Tenant-Id: 86ade54a72a44599b7a6313f909a3551 Aug 26 00:47:32.173372 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: X-Tenant-Name: admin Aug 26 00:47:32.173372 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: X-User: admin Aug 26 00:47:32.173372 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: X-User-Domain-Id: default Aug 26 00:47:32.173372 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: X-User-Domain-Name: Default Aug 26 00:47:32.173372 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: X-User-Id: 795669ccac0f433b900784c76b5b0142 Aug 26 00:47:32.173372 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: X-User-Name: admin Aug 26 00:47:32.173372 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: method: > Aug 26 00:47:32.173372 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: exception: Flavor 451 could not be found. Aug 26 00:47:32.173372 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: action_args: {'id': '451'} Aug 26 00:47:32.173372 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: {{(pid=112551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 00:47:32.173372 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:47:32.174177 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 26 00:47:32.174177 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 26 00:47:32.174177 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 26 00:47:32.174177 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 26 00:47:32.174177 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 26 00:47:32.174177 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 26 00:47:32.174177 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 26 00:47:32.174177 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 26 00:47:32.174177 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 26 00:47:32.174177 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 00:47:32.174177 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 26 00:47:32.174177 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 26 00:47:32.174177 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 26 00:47:32.174177 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi Aug 26 00:47:32.174177 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 00:47:32.174177 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi Aug 26 00:47:32.174177 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:47:32.174177 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 00:47:32.174177 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 00:47:32.175673 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 00:47:32.175673 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 00:47:32.175673 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 00:47:32.175673 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 00:47:32.175673 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 26 00:47:32.175673 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 26 00:47:32.175673 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 26 00:47:32.175673 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi Aug 26 00:47:32.175673 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 00:47:32.175673 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi Aug 26 00:47:32.175673 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:47:32.175673 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 00:47:32.175673 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 00:47:32.175673 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 00:47:32.175673 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 00:47:32.175673 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 26 00:47:32.175673 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: ERROR nova.api.openstack.wsgi Aug 26 00:47:32.175673 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi [None req-15796afb-f510-449e-9966-7df141b259e1 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 00:47:32.176969 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: INFO nova.api.openstack.requestlog [None req-15796afb-f510-449e-9966-7df141b259e1 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.385624 Aug 26 00:47:32.176969 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: [pid: 112551|app: 0|req: 24/49] 10.222.0.59 () {60 vars in 1193 bytes} [Fri Aug 26 00:47:31 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 387 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 26 00:47:32.182855 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi [None req-429ad5de-8633-4b69-a8df-6123e6404d51 admin admin] Calling method '>' {{(pid=112550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:47:32.198028 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: INFO nova.api.openstack.requestlog [None req-429ad5de-8633-4b69-a8df-6123e6404d51 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018716 Aug 26 00:47:32.198549 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: [pid: 112550|app: 0|req: 26/50] 10.222.0.59 () {60 vars in 1210 bytes} [Fri Aug 26 00:47:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:47:32.207706 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi [None req-6cc781e7-3983-42d3-9231-d4a9f0b11fa6 admin admin] Calling method '>' {{(pid=112551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:47:32.223140 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: INFO nova.api.openstack.requestlog [None req-6cc781e7-3983-42d3-9231-d4a9f0b11fa6 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018927 Aug 26 00:47:32.223653 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: [pid: 112551|app: 0|req: 25/51] 10.222.0.59 () {60 vars in 1210 bytes} [Fri Aug 26 00:47:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 00:47:32.232520 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi [None req-8d554fc9-9501-411a-b5a0-99ed0f5835b3 admin admin] Calling method '>' {{(pid=112550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:47:32.237705 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: INFO nova.api.openstack.wsgi [None req-8d554fc9-9501-411a-b5a0-99ed0f5835b3 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 26 00:47:32.239244 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi [None req-8d554fc9-9501-411a-b5a0-99ed0f5835b3 admin admin] Request method failure captured: Aug 26 00:47:32.239244 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 26 00:47:32.239244 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: Accept: application/json Aug 26 00:47:32.239244 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: Accept-Encoding: gzip, deflate Aug 26 00:47:32.239244 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: Connection: keep-alive Aug 26 00:47:32.239244 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: Content-Length: 0 Aug 26 00:47:32.239244 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: Host: 10.222.0.59 Aug 26 00:47:32.239244 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: Openstack-Api-Version: compute 2.90 Aug 26 00:47:32.239244 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: Openstack-System-Scope: None Aug 26 00:47:32.239244 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: User-Agent: python-novaclient Aug 26 00:47:32.239244 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: X-Auth-Token: gAAAAABjCBgjtkmy0EI4TmVVO_aF2i1Ynw6dce3miCbPU28GcuN14uJzKdpvdRoyC2yqFIoz2ssIP2WV6aqiJOTPCKWC7hWDdZqTGyuJ5TO7amokVHqoYMK_hP-a5jEuI0tnij9DwYjFzORpwdDDrm9B14WsSuSskHC6tyJuq-kH_5m3m-HeGmU Aug 26 00:47:32.239244 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: X-Domain-Id: None Aug 26 00:47:32.239244 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: X-Domain-Name: None Aug 26 00:47:32.239244 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: X-Identity-Status: Confirmed Aug 26 00:47:32.239244 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: X-Is-Admin-Project: True Aug 26 00:47:32.239244 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: X-Openstack-Nova-Api-Version: 2.90 Aug 26 00:47:32.239244 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: X-Project-Domain-Id: default Aug 26 00:47:32.239244 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: X-Project-Domain-Name: Default Aug 26 00:47:32.239244 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: X-Project-Id: 86ade54a72a44599b7a6313f909a3551 Aug 26 00:47:32.239244 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: X-Project-Name: admin Aug 26 00:47:32.239244 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: X-Role: reader,member,admin Aug 26 00:47:32.239244 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: X-Roles: reader,member,admin Aug 26 00:47:32.240950 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_86ade54a72a44599b7a6313f909a3551"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/86ade54a72a44599b7a6313f909a3551"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/86ade54a72a44599b7a6313f909a3551"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/86ade54a72a44599b7a6313f909a3551"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 00:47:32.240950 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: X-Tenant: admin Aug 26 00:47:32.240950 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: X-Tenant-Id: 86ade54a72a44599b7a6313f909a3551 Aug 26 00:47:32.240950 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: X-Tenant-Name: admin Aug 26 00:47:32.240950 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: X-User: admin Aug 26 00:47:32.240950 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: X-User-Domain-Id: default Aug 26 00:47:32.240950 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: X-User-Domain-Name: Default Aug 26 00:47:32.240950 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: X-User-Id: 795669ccac0f433b900784c76b5b0142 Aug 26 00:47:32.240950 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: X-User-Name: admin Aug 26 00:47:32.240950 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: method: > Aug 26 00:47:32.240950 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: exception: Flavor 451 could not be found. Aug 26 00:47:32.240950 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: action_args: {'id': '451'} Aug 26 00:47:32.240950 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: {{(pid=112550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 00:47:32.240950 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:47:32.242080 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 26 00:47:32.242080 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 26 00:47:32.242080 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 26 00:47:32.242080 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 26 00:47:32.242080 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 26 00:47:32.242080 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 26 00:47:32.242080 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 26 00:47:32.242080 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 26 00:47:32.242080 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 26 00:47:32.242080 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 00:47:32.242080 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 26 00:47:32.242080 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 26 00:47:32.242080 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 26 00:47:32.242080 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi Aug 26 00:47:32.242080 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 00:47:32.242080 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi Aug 26 00:47:32.242080 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:47:32.242080 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 00:47:32.242080 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 00:47:32.243389 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 00:47:32.243389 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 00:47:32.243389 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 00:47:32.243389 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 00:47:32.243389 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 26 00:47:32.243389 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 26 00:47:32.243389 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 26 00:47:32.243389 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi Aug 26 00:47:32.243389 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 00:47:32.243389 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi Aug 26 00:47:32.243389 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:47:32.243389 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 00:47:32.243389 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 00:47:32.243389 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 00:47:32.243389 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 00:47:32.243389 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 26 00:47:32.243389 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: ERROR nova.api.openstack.wsgi Aug 26 00:47:32.243389 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi [None req-8d554fc9-9501-411a-b5a0-99ed0f5835b3 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 00:47:32.244680 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: INFO nova.api.openstack.requestlog [None req-8d554fc9-9501-411a-b5a0-99ed0f5835b3 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011454 Aug 26 00:47:32.244680 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: [pid: 112550|app: 0|req: 27/52] 10.222.0.59 () {60 vars in 1193 bytes} [Fri Aug 26 00:47:32 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 26 00:47:33.214168 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi [None req-6cc781e7-3983-42d3-9231-d4a9f0b11fa6 admin admin] Calling method '>' {{(pid=112551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:47:33.215408 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: INFO nova.api.openstack.requestlog [None req-6cc781e7-3983-42d3-9231-d4a9f0b11fa6 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002627 Aug 26 00:47:33.215655 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: [pid: 112551|app: 0|req: 26/53] 10.222.0.59 () {56 vars in 1074 bytes} [Fri Aug 26 00:47:33 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:47:33.732869 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi [None req-1c609124-f275-4fc4-9c1f-960876a699ea admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:47:33.846702 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: INFO nova.api.openstack.requestlog [None req-1c609124-f275-4fc4-9c1f-960876a699ea admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.491819 Aug 26 00:47:33.847242 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: [pid: 112550|app: 0|req: 28/54] 10.222.0.59 () {64 vars in 1235 bytes} [Fri Aug 26 00:47:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 00:47:34.831155 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi [None req-6cc781e7-3983-42d3-9231-d4a9f0b11fa6 admin admin] Calling method '>' {{(pid=112551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:47:34.832159 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: INFO nova.api.openstack.requestlog [None req-6cc781e7-3983-42d3-9231-d4a9f0b11fa6 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Aug 26 00:47:34.832574 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: [pid: 112551|app: 0|req: 27/55] 10.222.0.59 () {56 vars in 1074 bytes} [Fri Aug 26 00:47:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:47:35.347033 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi [None req-23a8aca3-244f-4f6c-8fa9-cbd6abecd36f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:47:35.466726 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: INFO nova.api.openstack.requestlog [None req-23a8aca3-244f-4f6c-8fa9-cbd6abecd36f admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.497675 Aug 26 00:47:35.467270 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: [pid: 112550|app: 0|req: 29/56] 10.222.0.59 () {64 vars in 1235 bytes} [Fri Aug 26 00:47:34 2022] POST /compute/v2.1/flavors => generated 405 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 00:47:36.461042 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi [None req-6cc781e7-3983-42d3-9231-d4a9f0b11fa6 admin admin] Calling method '>' {{(pid=112551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:47:36.462038 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: INFO nova.api.openstack.requestlog [None req-6cc781e7-3983-42d3-9231-d4a9f0b11fa6 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Aug 26 00:47:36.462549 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: [pid: 112551|app: 0|req: 28/57] 10.222.0.59 () {56 vars in 1074 bytes} [Fri Aug 26 00:47:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:47:36.981170 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi [None req-abbf75ab-a481-4923-8e42-60e9b5c810fa admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:47:37.054925 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: INFO nova.api.openstack.requestlog [None req-abbf75ab-a481-4923-8e42-60e9b5c810fa admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.453676 Aug 26 00:47:37.055465 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: [pid: 112550|app: 0|req: 30/58] 10.222.0.59 () {64 vars in 1235 bytes} [Fri Aug 26 00:47:36 2022] POST /compute/v2.1/flavors => generated 407 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 00:47:38.016052 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi [None req-6cc781e7-3983-42d3-9231-d4a9f0b11fa6 admin admin] Calling method '>' {{(pid=112551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:47:38.017097 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: INFO nova.api.openstack.requestlog [None req-6cc781e7-3983-42d3-9231-d4a9f0b11fa6 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 26 00:47:38.017486 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: [pid: 112551|app: 0|req: 29/59] 10.222.0.59 () {56 vars in 1074 bytes} [Fri Aug 26 00:47:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:47:38.538887 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi [None req-1eada7e7-4899-4086-9024-2502c0d22c0c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:47:38.626010 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: INFO nova.api.openstack.requestlog [None req-1eada7e7-4899-4086-9024-2502c0d22c0c admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.467737 Aug 26 00:47:38.626560 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: [pid: 112550|app: 0|req: 31/60] 10.222.0.59 () {64 vars in 1235 bytes} [Fri Aug 26 00:47:38 2022] POST /compute/v2.1/flavors => generated 409 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 00:47:39.594222 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi [None req-6cc781e7-3983-42d3-9231-d4a9f0b11fa6 admin admin] Calling method '>' {{(pid=112551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:47:39.595235 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: INFO nova.api.openstack.requestlog [None req-6cc781e7-3983-42d3-9231-d4a9f0b11fa6 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001579 Aug 26 00:47:39.595624 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: [pid: 112551|app: 0|req: 30/61] 10.222.0.59 () {56 vars in 1074 bytes} [Fri Aug 26 00:47:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:47:40.114179 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi [None req-47d68e74-ea6a-4c7f-a26a-a4c8450cab3f admin admin] Calling method '>' {{(pid=112550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:47:40.134611 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: INFO nova.api.openstack.requestlog [None req-47d68e74-ea6a-4c7f-a26a-a4c8450cab3f admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.402526 Aug 26 00:47:40.135796 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: [pid: 112550|app: 0|req: 32/62] 10.222.0.59 () {60 vars in 1202 bytes} [Fri Aug 26 00:47:39 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:48:33.398383 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi [None req-6cc781e7-3983-42d3-9231-d4a9f0b11fa6 admin admin] Calling method '>' {{(pid=112551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:48:33.399400 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: INFO nova.api.openstack.requestlog [None req-6cc781e7-3983-42d3-9231-d4a9f0b11fa6 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Aug 26 00:48:33.399811 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: [pid: 112551|app: 0|req: 31/63] 10.222.0.59 () {54 vars in 931 bytes} [Fri Aug 26 00:48:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:48:33.411231 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG dbcounter [-] [112550] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=112550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:33.785907 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi [None req-cb267421-476b-4960-b307-15d1234402ac admin admin] Calling method '>' {{(pid=112550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:48:33.807988 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: INFO nova.api.openstack.requestlog [None req-cb267421-476b-4960-b307-15d1234402ac admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.401339 Aug 26 00:48:33.808567 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: [pid: 112550|app: 0|req: 33/64] 10.222.0.59 () {60 vars in 1292 bytes} [Fri Aug 26 00:48:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:48:33.830123 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG dbcounter [-] [112551] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=112551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:33.836078 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi [None req-4d7a3c52-a531-41a3-b5f7-1e5aa4362339 admin admin] Calling method '>' {{(pid=112551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:48:33.841754 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: INFO nova.api.openstack.requestlog [None req-4d7a3c52-a531-41a3-b5f7-1e5aa4362339 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013159 Aug 26 00:48:33.842253 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: [pid: 112551|app: 0|req: 32/65] 10.222.0.59 () {60 vars in 1283 bytes} [Fri Aug 26 00:48:33 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:48:33.854549 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi [None req-61c9c88c-fa25-4c0f-aa83-96e2e2b8fb8e admin admin] Calling method '>' {{(pid=112550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:48:33.863990 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: INFO nova.api.openstack.requestlog [None req-61c9c88c-fa25-4c0f-aa83-96e2e2b8fb8e admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013309 Aug 26 00:48:33.868199 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: [pid: 112550|app: 0|req: 34/66] 10.222.0.59 () {60 vars in 1286 bytes} [Fri Aug 26 00:48:33 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:48:33.877185 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi [None req-021eadb2-54b9-4f5a-aaf7-12ca537cdbeb admin admin] Calling method '>' {{(pid=112551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:48:33.884889 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: INFO nova.api.openstack.requestlog [None req-021eadb2-54b9-4f5a-aaf7-12ca537cdbeb admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011219 Aug 26 00:48:33.885988 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: [pid: 112551|app: 0|req: 33/67] 10.222.0.59 () {60 vars in 1286 bytes} [Fri Aug 26 00:48:33 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:48:33.897445 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi [None req-5de6e5cf-e834-4be6-acfb-58ed055472d8 admin admin] Calling method '>' {{(pid=112550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:48:33.905053 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: INFO nova.api.openstack.requestlog [None req-5de6e5cf-e834-4be6-acfb-58ed055472d8 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011194 Aug 26 00:48:33.905559 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: [pid: 112550|app: 0|req: 35/68] 10.222.0.59 () {60 vars in 1283 bytes} [Fri Aug 26 00:48:33 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:51:41.622723 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi [None req-021eadb2-54b9-4f5a-aaf7-12ca537cdbeb admin admin] Calling method '>' {{(pid=112551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:51:41.623943 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: INFO nova.api.openstack.requestlog [None req-021eadb2-54b9-4f5a-aaf7-12ca537cdbeb admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Aug 26 00:51:41.624335 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: [pid: 112551|app: 0|req: 34/69] 10.222.0.59 () {56 vars in 1074 bytes} [Fri Aug 26 00:51:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:51:41.772361 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG dbcounter [-] [112550] Writing DB stats nova_api:SELECT=6 {{(pid=112550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:41.924160 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi [None req-c1fa2d0c-e9cb-4c79-a9be-ce97d1cd07b2 admin admin] Calling method '>' {{(pid=112550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:51:41.927634 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG oslo_concurrency.lockutils [None req-c1fa2d0c-e9cb-4c79-a9be-ce97d1cd07b2 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:51:41.928109 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG oslo_concurrency.lockutils [None req-c1fa2d0c-e9cb-4c79-a9be-ce97d1cd07b2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:51:41.928563 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG oslo_concurrency.lockutils [None req-c1fa2d0c-e9cb-4c79-a9be-ce97d1cd07b2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:51:41.929275 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG oslo_concurrency.lockutils [None req-c1fa2d0c-e9cb-4c79-a9be-ce97d1cd07b2 admin admin] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:51:41.929719 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG oslo_concurrency.lockutils [None req-c1fa2d0c-e9cb-4c79-a9be-ce97d1cd07b2 admin admin] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:51:41.930135 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG oslo_concurrency.lockutils [None req-c1fa2d0c-e9cb-4c79-a9be-ce97d1cd07b2 admin admin] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:51:41.963759 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: INFO nova.api.openstack.requestlog [None req-c1fa2d0c-e9cb-4c79-a9be-ce97d1cd07b2 admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.196805 Aug 26 00:51:41.964236 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: [pid: 112550|app: 0|req: 36/70] 10.222.0.59 () {60 vars in 1193 bytes} [Fri Aug 26 00:51:41 2022] GET /compute/v2.1/os-services => generated 794 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 00:51:42.791653 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi [None req-021eadb2-54b9-4f5a-aaf7-12ca537cdbeb admin admin] Calling method '>' {{(pid=112551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:51:42.792729 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: INFO nova.api.openstack.requestlog [None req-021eadb2-54b9-4f5a-aaf7-12ca537cdbeb admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001663 Aug 26 00:51:42.793130 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: [pid: 112551|app: 0|req: 35/71] 10.222.0.59 () {56 vars in 1074 bytes} [Fri Aug 26 00:51:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:51:42.989086 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi [None req-62de18cb-f635-4300-a60c-c99bc92b3c4d admin admin] Calling method '>' {{(pid=112550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:51:42.992953 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG oslo_concurrency.lockutils [None req-62de18cb-f635-4300-a60c-c99bc92b3c4d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:51:42.993428 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG oslo_concurrency.lockutils [None req-62de18cb-f635-4300-a60c-c99bc92b3c4d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:51:42.993857 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG oslo_concurrency.lockutils [None req-62de18cb-f635-4300-a60c-c99bc92b3c4d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:51:42.994565 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG oslo_concurrency.lockutils [None req-62de18cb-f635-4300-a60c-c99bc92b3c4d admin admin] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:51:42.995005 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG oslo_concurrency.lockutils [None req-62de18cb-f635-4300-a60c-c99bc92b3c4d admin admin] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:51:42.995422 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG oslo_concurrency.lockutils [None req-62de18cb-f635-4300-a60c-c99bc92b3c4d admin admin] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:51:43.014930 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: INFO nova.api.openstack.requestlog [None req-62de18cb-f635-4300-a60c-c99bc92b3c4d admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.078238 Aug 26 00:51:43.015422 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: [pid: 112550|app: 0|req: 37/72] 10.222.0.59 () {60 vars in 1193 bytes} [Fri Aug 26 00:51:42 2022] GET /compute/v2.1/os-services => generated 794 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 00:51:54.377952 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi [None req-021eadb2-54b9-4f5a-aaf7-12ca537cdbeb admin admin] Calling method '>' {{(pid=112551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:51:54.378995 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: INFO nova.api.openstack.requestlog [None req-021eadb2-54b9-4f5a-aaf7-12ca537cdbeb admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Aug 26 00:51:54.379387 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: [pid: 112551|app: 0|req: 36/73] 10.222.0.59 () {56 vars in 1074 bytes} [Fri Aug 26 00:51:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:51:54.525464 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG dbcounter [-] [112550] Writing DB stats nova_cell0:SELECT=4 {{(pid=112550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:54.526214 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG dbcounter [-] [112550] Writing DB stats nova_cell1:SELECT=4 {{(pid=112550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:54.526821 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG dbcounter [-] [112550] Writing DB stats nova_api:SELECT=8 {{(pid=112550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:54.579570 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi [None req-43188600-1800-41cc-ada2-ad9cd43e5018 admin admin] Calling method '>' {{(pid=112550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:51:54.586137 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG oslo_concurrency.lockutils [None req-43188600-1800-41cc-ada2-ad9cd43e5018 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:51:54.586589 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG oslo_concurrency.lockutils [None req-43188600-1800-41cc-ada2-ad9cd43e5018 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:51:54.587010 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG oslo_concurrency.lockutils [None req-43188600-1800-41cc-ada2-ad9cd43e5018 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:51:54.587760 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG oslo_concurrency.lockutils [None req-43188600-1800-41cc-ada2-ad9cd43e5018 admin admin] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:51:54.588235 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG oslo_concurrency.lockutils [None req-43188600-1800-41cc-ada2-ad9cd43e5018 admin admin] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:51:54.588718 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG oslo_concurrency.lockutils [None req-43188600-1800-41cc-ada2-ad9cd43e5018 admin admin] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:51:54.614920 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: INFO nova.api.openstack.requestlog [None req-43188600-1800-41cc-ada2-ad9cd43e5018 admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.093837 Aug 26 00:51:54.615478 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: [pid: 112550|app: 0|req: 38/74] 10.222.0.59 () {60 vars in 1193 bytes} [Fri Aug 26 00:51:54 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:51:55.449120 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: DEBUG nova.api.openstack.wsgi [None req-021eadb2-54b9-4f5a-aaf7-12ca537cdbeb admin admin] Calling method '>' {{(pid=112551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:51:55.450122 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: INFO nova.api.openstack.requestlog [None req-021eadb2-54b9-4f5a-aaf7-12ca537cdbeb admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Aug 26 00:51:55.450513 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: [pid: 112551|app: 0|req: 37/75] 10.222.0.59 () {56 vars in 1074 bytes} [Fri Aug 26 00:51:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:51:55.654906 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG nova.api.openstack.wsgi [None req-caccc762-86b6-44d5-b71f-b1b2cc397d52 admin admin] Calling method '>' {{(pid=112550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:51:55.658407 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG oslo_concurrency.lockutils [None req-caccc762-86b6-44d5-b71f-b1b2cc397d52 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:51:55.658877 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG oslo_concurrency.lockutils [None req-caccc762-86b6-44d5-b71f-b1b2cc397d52 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:51:55.659553 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG oslo_concurrency.lockutils [None req-caccc762-86b6-44d5-b71f-b1b2cc397d52 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:51:55.660262 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG oslo_concurrency.lockutils [None req-caccc762-86b6-44d5-b71f-b1b2cc397d52 admin admin] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:51:55.660755 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG oslo_concurrency.lockutils [None req-caccc762-86b6-44d5-b71f-b1b2cc397d52 admin admin] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:51:55.661163 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: DEBUG oslo_concurrency.lockutils [None req-caccc762-86b6-44d5-b71f-b1b2cc397d52 admin admin] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:51:55.685659 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: INFO nova.api.openstack.requestlog [None req-caccc762-86b6-44d5-b71f-b1b2cc397d52 admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.094186 Aug 26 00:51:55.686636 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: [pid: 112550|app: 0|req: 39/76] 10.222.0.59 () {60 vars in 1193 bytes} [Fri Aug 26 00:51:55 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:52:52.335292 dv-cinder-835384-25-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 26 00:52:52.335904 dv-cinder-835384-25-iscsi devstack@n-api.service[112549]: Fri Aug 26 00:52:52 2022 - graceful shutdown triggered... Aug 26 00:52:52.336396 dv-cinder-835384-25-iscsi devstack@n-api.service[112550]: Gracefully killing worker 1 (pid: 112550)... Aug 26 00:52:52.336863 dv-cinder-835384-25-iscsi devstack@n-api.service[112551]: Gracefully killing worker 2 (pid: 112551)... Aug 26 00:52:53.336799 dv-cinder-835384-25-iscsi devstack@n-api.service[112549]: worker 1 buried after 1 seconds Aug 26 00:52:53.337455 dv-cinder-835384-25-iscsi devstack@n-api.service[112549]: worker 2 buried after 1 seconds Aug 26 00:52:53.337455 dv-cinder-835384-25-iscsi devstack@n-api.service[112549]: goodbye to uWSGI. Aug 26 00:52:53.338728 dv-cinder-835384-25-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 26 00:52:53.339382 dv-cinder-835384-25-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 26 00:52:53.342366 dv-cinder-835384-25-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 26 00:52:53.354710 dv-cinder-835384-25-iscsi devstack@n-api.service[127552]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 26 00:52:53.356927 dv-cinder-835384-25-iscsi devstack@n-api.service[127552]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 26 00:52:53 2022] *** Aug 26 00:52:53.356927 dv-cinder-835384-25-iscsi devstack@n-api.service[127552]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 26 00:52:53.356927 dv-cinder-835384-25-iscsi devstack@n-api.service[127552]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 26 00:52:53.356927 dv-cinder-835384-25-iscsi devstack@n-api.service[127552]: nodename: dv-cinder-835384-25-iscsi Aug 26 00:52:53.356927 dv-cinder-835384-25-iscsi devstack@n-api.service[127552]: machine: x86_64 Aug 26 00:52:53.356927 dv-cinder-835384-25-iscsi devstack@n-api.service[127552]: clock source: unix Aug 26 00:52:53.356927 dv-cinder-835384-25-iscsi devstack@n-api.service[127552]: pcre jit disabled Aug 26 00:52:53.356927 dv-cinder-835384-25-iscsi devstack@n-api.service[127552]: detected number of CPU cores: 4 Aug 26 00:52:53.356927 dv-cinder-835384-25-iscsi devstack@n-api.service[127552]: current working directory: / Aug 26 00:52:53.356927 dv-cinder-835384-25-iscsi devstack@n-api.service[127552]: detected binary path: /usr/bin/uwsgi-core Aug 26 00:52:53.356927 dv-cinder-835384-25-iscsi devstack@n-api.service[127552]: your processes number limit is 47680 Aug 26 00:52:53.357810 dv-cinder-835384-25-iscsi devstack@n-api.service[127552]: your memory page size is 4096 bytes Aug 26 00:52:53.357810 dv-cinder-835384-25-iscsi devstack@n-api.service[127552]: detected max file descriptor number: 2048 Aug 26 00:52:53.357810 dv-cinder-835384-25-iscsi devstack@n-api.service[127552]: lock engine: pthread robust mutexes Aug 26 00:52:53.357810 dv-cinder-835384-25-iscsi devstack@n-api.service[127552]: thunder lock: enabled Aug 26 00:52:53.357810 dv-cinder-835384-25-iscsi devstack@n-api.service[127552]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 26 00:52:53.357810 dv-cinder-835384-25-iscsi devstack@n-api.service[127552]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 26 00:52:53.398165 dv-cinder-835384-25-iscsi devstack@n-api.service[127552]: Python main interpreter initialized at 0x555a717779c0 Aug 26 00:52:53.398165 dv-cinder-835384-25-iscsi devstack@n-api.service[127552]: python threads support enabled Aug 26 00:52:53.398165 dv-cinder-835384-25-iscsi devstack@n-api.service[127552]: your server socket listen backlog is limited to 100 connections Aug 26 00:52:53.398165 dv-cinder-835384-25-iscsi devstack@n-api.service[127552]: your mercy for graceful operations on workers is 90 seconds Aug 26 00:52:53.398613 dv-cinder-835384-25-iscsi devstack@n-api.service[127552]: mapped 403077 bytes (393 KB) for 2 cores Aug 26 00:52:53.398613 dv-cinder-835384-25-iscsi devstack@n-api.service[127552]: *** Operational MODE: preforking *** Aug 26 00:52:53.398868 dv-cinder-835384-25-iscsi devstack@n-api.service[127552]: *** uWSGI is running in multiple interpreter mode *** Aug 26 00:52:53.398868 dv-cinder-835384-25-iscsi devstack@n-api.service[127552]: spawned uWSGI master process (pid: 127552) Aug 26 00:52:53.399068 dv-cinder-835384-25-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 26 00:52:53.400554 dv-cinder-835384-25-iscsi devstack@n-api.service[127552]: spawned uWSGI worker 1 (pid: 127564, cores: 1) Aug 26 00:52:53.400554 dv-cinder-835384-25-iscsi devstack@n-api.service[127552]: spawned uWSGI worker 2 (pid: 127565, cores: 1) Aug 26 00:52:53.400554 dv-cinder-835384-25-iscsi devstack@n-api.service[127552]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 26 00:52:54.062687 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 26 00:52:54.063962 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 26 00:52:55.224385 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 00:52:55.224385 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: from cryptography.utils import int_from_bytes Aug 26 00:52:55.225242 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 00:52:55.225242 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: from cryptography.utils import int_from_bytes Aug 26 00:52:55.228906 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 00:52:55.228906 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: from cryptography.utils import int_from_bytes Aug 26 00:52:55.229382 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 00:52:55.229382 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: from cryptography.utils import int_from_bytes Aug 26 00:52:57.647939 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 26 00:52:57.647939 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 26 00:52:57.647939 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 26 00:52:57.647939 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 26 00:52:57.647939 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 26 00:52:57.647939 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.647939 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.647939 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.649019 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.649019 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.649019 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.649019 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.649019 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.649019 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.649463 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.649463 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.649947 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835384-25-iscsi {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.650057 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.650312 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.650631 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.650954 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.651266 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.651596 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.651910 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.652411 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.653790 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.653790 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.653790 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.654156 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.654459 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.654776 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.655103 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.655417 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.655747 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.656061 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.656488 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835384-25-iscsi {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.656815 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.657136 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.657458 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.657885 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.658202 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.658512 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.658844 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.659170 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.659481 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.660097 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.660423 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.660779 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.661124 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.661414 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.661725 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.662040 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.662363 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.662678 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.663522 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 26 00:52:57.663933 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.664018 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 26 00:52:57.664099 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.664183 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.664406 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 26 00:52:57.664543 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.664720 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 26 00:52:57.664838 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.665009 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 26 00:52:57.665165 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.665389 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.665498 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.665654 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.665758 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.665959 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.666079 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.666293 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.666399 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.666603 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.666766 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.666922 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.667068 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.667189 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.667392 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.667570 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.667722 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.667871 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.668031 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.668180 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.668330 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.668513 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.668662 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.668816 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.668959 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835384-25-iscsi {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.669108 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.669262 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.669414 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.669584 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.669808 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.670173 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.670321 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.670464 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.670605 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.670758 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.670937 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.671081 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.671228 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.671369 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.671542 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.671542 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.671867 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.672057 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.672213 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.672372 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.672545 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.672711 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.672885 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.673036 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.673184 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.673326 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.673486 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.673643 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.673792 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.673941 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.674091 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.674240 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.674399 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.674541 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.674691 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.674843 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.675216 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.675379 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.675537 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835384-25-iscsi {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.675693 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.675842 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.675994 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.676949 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.677121 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.677268 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.677970 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.677970 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.678221 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.678341 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.678469 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.678601 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.678880 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.679515 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.679641 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.679765 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.679765 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.679995 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.680118 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.680238 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.680603 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.687725 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.687917 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.688079 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.688236 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.688428 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.688818 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.688983 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.689129 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.689273 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.689416 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.689566 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.689802 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.689969 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.690122 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.690289 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.690445 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.690588 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.690755 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.690941 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.691089 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.691242 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.691415 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.691896 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.692120 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.692269 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.692826 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.693041 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.693192 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.693335 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.693482 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.693646 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.693798 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.693983 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.694168 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.694314 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.694466 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.694621 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.694776 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.694919 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.695109 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.695271 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.695424 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.695574 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.695732 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.695916 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.696122 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.696271 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.696728 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.696894 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.697096 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.697290 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.697439 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.697580 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.697761 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.697913 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.698071 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.698227 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.698370 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.698519 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.698661 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.698812 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.698999 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.699159 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.699346 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.699346 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.699628 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.699787 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.699949 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.700127 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.700273 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.700415 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.700592 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.700747 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.700891 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.701040 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.701190 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.701381 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.701530 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.701692 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.701998 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.702161 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.702304 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.702304 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.703327 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.703443 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.703534 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.703614 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.703696 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.703779 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.703872 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.703955 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.704030 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.704109 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.704204 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.704301 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.704402 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.704524 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.704664 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.704762 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.704858 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.704955 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.705054 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.705143 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.705229 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.705324 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.705419 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.705515 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.705611 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.705698 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.705791 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.705877 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.705963 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.706062 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.706150 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.706235 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.706320 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.706406 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.706501 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.706602 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.706697 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.706792 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.706879 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.706974 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.706974 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.707206 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.707303 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.707398 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.707485 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.707570 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.707668 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.707762 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.707867 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.707955 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.708047 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.708145 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.708244 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.708333 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.708425 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.708547 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.708637 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.708721 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.708805 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.708899 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.708995 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.709094 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.709188 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.709281 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.709376 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.709463 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.709547 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.709637 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.710260 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.710400 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.710533 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.710628 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.710749 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.710749 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.710929 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.711022 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.711108 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.711199 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.711295 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.711382 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.711467 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.711559 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.711559 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.711734 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.711821 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.711925 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.711925 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.712065 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.712065 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.712218 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.712308 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.712405 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.722301 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.722476 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.722629 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.722793 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.722957 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.723253 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.723407 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.723713 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.723875 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.724030 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.724181 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.724335 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.724514 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.724665 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.724819 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:52:57.724972 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.725116 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.725268 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.725485 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.726191 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.726347 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.726499 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.726658 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.726809 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.726971 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.727204 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.727204 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.727625 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.727784 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.727936 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.728086 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.728230 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.728391 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.728570 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.728734 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.728886 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.729044 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.729196 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.729346 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.729498 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.729649 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.729799 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.729942 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.730094 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.730238 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.730407 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.730550 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.730816 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.730983 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.731152 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.731312 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.731478 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.731628 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.731785 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.731942 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.732107 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.732284 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.732661 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.732834 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.732986 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.733163 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.733440 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.733624 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.733990 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.734189 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.734346 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.734506 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.734657 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.734820 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.735020 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.735195 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.735353 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.735504 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.735653 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.735815 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.735973 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.736131 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.736288 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.736288 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.736636 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.736804 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.736966 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.736966 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.737357 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.737357 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.737782 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.737934 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.738090 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.738240 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.738397 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.738397 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.738690 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.738840 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.738996 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.739146 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.739294 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.739466 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.739625 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.739829 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.740013 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.740178 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.740336 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.740531 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.740710 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.741482 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.741656 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.741817 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.741967 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.742141 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.742335 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.742570 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.742813 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.742983 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.743143 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.743508 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.743669 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.743844 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.744189 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.744351 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.744531 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.744731 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.744902 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.745054 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.745203 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.745203 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.745485 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.749813 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.751000 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.751178 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.751906 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.752260 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.752416 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.752416 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.752758 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.752969 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.753133 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.753328 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.753505 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.754589 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.754926 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.755146 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.755309 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.755309 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.755649 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.755856 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.756018 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.756169 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.756318 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.756496 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.767763 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.768842 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.769055 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.769239 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.769398 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.769601 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.769760 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.769920 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.770104 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.770261 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.770428 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.770617 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.770773 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.771305 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.771476 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.771667 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.771847 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.771998 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.772204 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.772375 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.772556 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.772792 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.772963 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.773124 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.773284 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.773442 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.773594 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.773752 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.774033 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.774931 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.775672 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.775814 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.776082 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.776192 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.776289 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.776420 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.776543 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.776626 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.776711 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.776794 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.776917 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.776998 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.777069 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.777147 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.777237 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.777325 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.777406 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.777494 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.777567 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.777650 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.777758 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.777855 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.777950 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.778036 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.778127 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.778219 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.778219 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.778429 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.778531 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.778625 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.778717 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.778808 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.778902 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.779026 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.779124 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.779214 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.779295 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.779380 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.779466 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.779552 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.779634 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.779724 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.779809 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.779900 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.779997 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.780083 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.780174 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.780258 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.780341 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.780437 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.780540 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.780625 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.780707 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.780786 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.780881 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.780976 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.781124 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.781227 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.781320 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.781406 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.781497 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.781597 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.781683 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.781774 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.781859 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.781951 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.782043 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.782142 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.782235 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.782320 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.782628 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.782725 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.782818 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.782918 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.783004 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.783095 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.783180 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.783264 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.783356 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.783442 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.783533 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.783618 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.783702 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.783785 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.783882 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.783982 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.784076 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.784168 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.784252 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.784581 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.784980 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.785072 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.785183 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.785268 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.785352 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.785442 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.785536 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.785621 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.785724 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.785809 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.785894 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.785986 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.786071 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.786154 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.786236 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.786326 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.786418 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.786564 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.786946 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.787045 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.787142 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.787236 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.787330 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.787494 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.787590 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.787675 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.787759 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.788375 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.788506 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.788615 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.788704 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.788796 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.788877 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.788969 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.789067 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.789067 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.789233 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.789318 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.789408 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.789493 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.789589 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.789678 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.789762 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.789853 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.789956 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.790038 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.790119 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.790200 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.790305 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.790388 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.790461 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.790530 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.790607 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.790693 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.790772 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.790871 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.790957 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.791038 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.791110 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.791180 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.791270 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.791365 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.791450 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.791532 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.791622 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.791706 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.791796 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.791889 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.791974 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.792065 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.792157 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.792241 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.792337 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.792449 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.792565 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.792884 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.792971 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.793055 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.793151 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.793244 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.793317 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.793387 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.793469 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.793560 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.793658 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.793751 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.793850 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.793935 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.794026 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.794118 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.794212 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.794297 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.794297 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.794459 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.794459 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.794807 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.794902 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.794995 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.795089 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.795175 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.795266 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.795360 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.795454 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.795540 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.795624 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.795714 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.795800 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.795893 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.795985 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.796076 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.796157 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.796236 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.796321 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.796413 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.796527 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.796614 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.796697 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.796792 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.796886 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.796996 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.797092 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.797184 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.797279 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.797364 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.797449 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.797542 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.797635 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.797727 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.797812 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.797902 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.797996 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.798082 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.798171 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.798256 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.798340 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.798430 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.799223 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.799326 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.799414 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.799505 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.799644 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.799751 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.799840 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.799840 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.800003 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.800088 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.800179 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.800274 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.800368 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.800442 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.800584 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.800694 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.800804 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.800901 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.800988 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.801072 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.801172 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.801266 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.801360 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.801452 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.801540 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.801622 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.801778 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.801863 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.801943 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.802017 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.802096 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.802176 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.802258 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.802332 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.802410 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.802483 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.802553 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.802631 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.802713 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.802788 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.802891 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.802972 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.803052 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.803137 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.803210 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.803281 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.803358 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.803452 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.803561 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.803654 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.803728 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.803907 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.803997 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.804079 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.804152 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.804237 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.804237 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.804378 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.804449 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.804558 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.804634 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.804713 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.804962 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.805038 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.805118 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.805191 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.805271 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.805344 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.805415 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.805485 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.805562 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.805635 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.805793 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.805868 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.806029 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.806105 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.806176 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.806246 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.806330 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.806330 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.806472 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.806545 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.806629 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.806710 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.806794 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.806867 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.806938 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.806938 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.807085 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.807166 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.807239 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.807316 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.807389 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.807459 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.807536 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.807620 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.807693 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.807770 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.807842 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.807911 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.808022 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.808116 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.808197 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.808269 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.808340 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.808416 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.808574 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.819770 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.819987 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.820131 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.820238 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.820331 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.820429 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.820617 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.820720 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.820808 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.820892 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.820985 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.821159 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.821252 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.821335 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.821408 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.821508 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.821603 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.821703 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.821797 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.821904 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.821997 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.822084 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.822171 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.822366 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.822473 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.822561 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.822646 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.822737 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.822737 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.822912 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.822992 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.823064 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.823135 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.823206 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.823286 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.823366 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.823366 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.823560 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.823648 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.823741 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.823837 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.823930 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.824006 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.824350 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.824452 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.824600 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.824706 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.824810 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.824904 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.825013 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.825095 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.825176 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.825255 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.825341 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.825425 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.825517 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.825603 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.825727 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.825822 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.825904 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.825984 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.826069 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.826149 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.826232 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.826343 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.826430 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.826528 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.826614 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.826705 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.826806 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.826893 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.826977 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.827061 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.827144 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.827241 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.827327 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.827412 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.827497 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.827581 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.827672 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.827771 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.827858 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.827938 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.827938 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.828067 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.828145 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.828232 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.828319 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.828393 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.828393 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.828669 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.828745 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.828848 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.828936 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.828936 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.828936 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.829185 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.829280 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.829367 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.829451 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.829534 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.829625 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.829714 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.829827 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.829902 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.829985 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.829985 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.830156 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.830242 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.830340 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.830435 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.830521 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.830605 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.830687 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.830687 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.830853 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.830940 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.831024 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.831108 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.831199 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.831297 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.831390 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.831475 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.831558 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.831643 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.831727 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.831809 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.831894 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.831978 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.832071 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.832156 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.832248 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.832248 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.832429 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.832542 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.832637 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.832723 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.832806 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.832903 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.832990 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.833081 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.833166 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.833258 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.833357 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.833451 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.833544 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.833631 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.833714 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.833805 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.833905 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.833992 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.834084 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.834178 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.834270 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.834500 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.834608 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.834760 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.835441 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.835524 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.835610 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.835696 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.835795 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.835890 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.835977 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.836061 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.836144 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.836243 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.836330 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.836415 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.836532 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.836621 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.836706 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.836806 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.836894 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.836978 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.837071 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.837165 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.837251 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.837346 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.837473 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.837572 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.837660 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.837758 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.837852 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.837939 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.838011 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.838082 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.838159 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.838241 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.838321 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.838394 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.838492 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.838567 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.839338 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.839449 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.839548 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.839636 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.839720 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.839809 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.839902 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.839998 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.840072 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.840157 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.840242 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.840327 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.840430 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.840535 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.840635 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.840723 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.840809 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.840901 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.841001 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.841097 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.841097 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.841260 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.841355 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.841449 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.841548 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.841635 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.841720 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.841813 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.841908 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.841995 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.842089 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.842089 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.842229 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.842308 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.842308 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.842456 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.842537 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.842610 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.842687 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.842765 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.842839 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.842839 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.842989 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.843063 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.843141 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.843213 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.843297 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.843396 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.843470 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.843548 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.843627 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.843700 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.843771 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.843850 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.843930 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.844009 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.844081 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.844151 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.844240 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.844319 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.844399 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.844663 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.844749 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.844836 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.844920 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.845002 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.845075 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.845146 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.845217 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.845295 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.845376 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.845451 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.845521 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.845637 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.845720 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.845793 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.845879 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.845953 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.845953 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.846096 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.846191 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.846277 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.846381 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.846464 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.846537 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.846615 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.846687 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.846767 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.846872 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.846996 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.847100 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.847174 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.847253 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.847340 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.847420 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.847490 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.847576 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.847649 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.847649 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.847786 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.847859 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.847937 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.848010 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.848088 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.848175 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.848249 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.848320 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.848396 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.848493 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.848571 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.848660 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.848983 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.849078 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.849161 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.849241 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.849323 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.849406 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.849481 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.849552 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.849631 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.849704 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.849795 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.849892 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.849965 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.850045 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.850126 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.850199 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.850284 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.850365 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.850448 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.850522 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.850522 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.850650 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.850734 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.850808 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.850885 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.850965 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.851044 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.851169 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.851247 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.851318 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.851389 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.851466 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.851545 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.851632 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.851706 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.851778 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.851778 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.851904 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.851976 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.851976 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.852122 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.852122 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.852261 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.852355 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.852456 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.853264 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.853366 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.853454 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.853547 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.853547 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.853708 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.853708 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.853883 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.853968 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.854053 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.854053 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.854227 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.854323 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.854416 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.854510 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.854510 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.854510 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.854785 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.854874 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.854958 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.855042 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.855133 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.855233 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.855327 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.855327 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.855484 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.855576 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.855668 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.855840 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.855929 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.856022 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.856116 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.856116 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.856282 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.856376 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.856457 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.856573 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.856669 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.856762 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.856762 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.856947 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.857042 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.857128 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.857212 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.857303 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.857399 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.857492 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.857586 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.857672 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.857757 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.857842 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.857935 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.858020 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.858020 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.858175 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.858267 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.858348 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.858430 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.858504 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.858587 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.858685 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.858768 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.858861 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.858948 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.859057 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.859139 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.859225 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.859316 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.859416 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.859502 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.859590 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.859683 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.859782 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.859782 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.860091 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.860205 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.860294 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.860390 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.860604 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.860706 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.860814 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.860950 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.861045 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.861131 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.861216 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.861317 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.861414 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.861414 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.861572 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.861657 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.861741 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.861841 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.861936 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.862024 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.862109 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.862109 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.862280 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.862381 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.862475 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.862572 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.862658 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.862751 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.862851 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.862948 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.863035 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.863133 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.863221 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.863359 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.863484 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.863600 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.863719 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.863844 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.863947 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.864035 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.864121 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.864227 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.864315 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.864409 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.864512 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.864618 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.864718 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.864855 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.864958 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.865053 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.865140 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.865240 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.865328 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.865414 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.865499 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.865592 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.865679 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.865778 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.865865 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.865959 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.866054 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.866220 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.866351 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.866539 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.866680 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.866856 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.867015 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.867206 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.867336 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.867528 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.867650 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.867962 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.868064 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.868277 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.868391 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.868727 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.868833 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.869064 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.869204 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.869398 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.869503 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.869712 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.869814 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.870024 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.870169 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.870347 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.870481 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.870686 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.870825 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.870978 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.871203 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.871356 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.871484 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.871598 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.871711 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.871894 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.872005 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.872200 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.872294 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.872530 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.872643 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.872848 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.872950 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.873156 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.873258 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.873461 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.873556 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.873771 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.873880 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.874089 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.874193 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.874409 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.874721 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.874898 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.875281 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.875705 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.875876 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.876042 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.876211 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.876378 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.876605 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.876814 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.876974 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.877128 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.877287 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.877454 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.877620 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.877787 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.877947 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.878109 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.878262 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.878439 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.878592 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.878751 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.878904 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.879064 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.879236 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.879408 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.879561 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.879725 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.879883 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.880047 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.880209 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.880385 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.880575 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.880761 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.880992 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.881158 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.881322 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.881422 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.881510 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.882103 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.882341 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.882499 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.882659 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.882829 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.883059 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.883233 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.883417 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.883514 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.883795 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.883891 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.884136 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.884241 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.884443 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.884618 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.884801 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.884903 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.885131 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.885232 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.885451 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.885555 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.885759 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.885853 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.886078 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.886163 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.886387 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.886717 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.886892 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.887054 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.887159 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.887331 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.887435 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.887646 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.887826 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.887956 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.888278 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.888628 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.888747 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.889001 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.889208 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.889311 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.889407 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.889549 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.889698 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.889860 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.889982 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.890171 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.890320 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.890481 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.890639 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.890796 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.890987 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.891116 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.891401 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.891510 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.891716 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.892138 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.892249 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.892346 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.892447 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.892694 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.892921 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.893027 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.893266 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.893441 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.893581 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.893824 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.893921 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.894142 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.894236 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.894462 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.894563 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.894785 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.895098 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.895839 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.896062 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.896062 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.896218 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.896307 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.896384 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.896459 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.896628 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.902331 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.902511 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.902612 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.902703 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.902791 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.902865 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.902947 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.903054 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.903194 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.903286 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.903380 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.903474 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.903562 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.903664 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.903753 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.903838 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.903932 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.904021 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.904117 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.904210 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.904297 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.904391 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.904553 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.904647 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.904749 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.904846 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.904935 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.905028 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.905116 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.905213 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.905312 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.905400 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.905493 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.905641 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.905742 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.905840 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.905929 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.906064 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.906179 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.906292 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.906414 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.906519 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.906613 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.906709 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.906797 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.906900 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.906991 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.907091 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.907302 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.907403 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.907491 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.907594 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.907742 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.907836 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.907923 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.908016 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.908103 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.908198 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.908334 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.908439 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.908547 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.908636 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.908727 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.908836 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.908943 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.909042 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.909132 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.909218 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.909305 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.909410 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.909513 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.909602 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.909939 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.910040 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.910137 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.910239 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.910329 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.910423 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.910511 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.910597 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.910689 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.910790 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.910885 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.910981 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.911075 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 26 00:52:57.911196 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.911196 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.911196 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.911425 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.911790 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.912102 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.912409 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.912740 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.913096 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.913404 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.913737 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.914073 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.914379 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.914684 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.914988 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.915292 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.915594 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.915905 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.916206 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.916527 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.916833 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.917134 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.917577 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.917989 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.918348 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.918663 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.919020 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.919334 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.919657 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.919966 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.920313 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.920656 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.920974 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.921284 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.921627 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.921924 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.923223 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.923223 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.923223 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.923223 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.923650 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.923739 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.924048 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.924354 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.925746 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.925977 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.926450 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.926784 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.927104 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.927447 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.927762 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.928080 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.928393 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.928766 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.929082 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.929401 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.929711 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.930024 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.930343 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.930658 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.930987 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.931315 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.931624 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.932340 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.932340 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.932732 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.932941 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.933282 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.933611 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.933926 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.934238 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.934544 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:52:57.934787 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 26 00:52:57.972888 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO dbcounter [None req-c45bf8c9-8995-4990-ae62-7f6294cd98a1 None None] Registered counter for database nova_api Aug 26 00:52:57.994712 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_db.sqlalchemy.engines [None req-c45bf8c9-8995-4990-ae62-7f6294cd98a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127565) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 00:52:57.997677 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO dbcounter [None req-be9880ae-bf64-4dc2-aa0a-60e316315773 None None] Registered counter for database nova_api Aug 26 00:52:58.001613 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writer thread running {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 00:52:58.018842 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_db.sqlalchemy.engines [None req-be9880ae-bf64-4dc2-aa0a-60e316315773 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127564) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 00:52:58.025756 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writer thread running {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 00:52:58.059153 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.context [None req-c45bf8c9-8995-4990-ae62-7f6294cd98a1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a(cell1) {{(pid=127565) load_cells /opt/stack/nova/nova/context.py:464}} Aug 26 00:52:58.063256 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c45bf8c9-8995-4990-ae62-7f6294cd98a1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:52:58.063741 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c45bf8c9-8995-4990-ae62-7f6294cd98a1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:52:58.065397 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c45bf8c9-8995-4990-ae62-7f6294cd98a1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:52:58.066148 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c45bf8c9-8995-4990-ae62-7f6294cd98a1 None None] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:52:58.066603 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c45bf8c9-8995-4990-ae62-7f6294cd98a1 None None] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:52:58.068642 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c45bf8c9-8995-4990-ae62-7f6294cd98a1 None None] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:52:58.070790 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO dbcounter [None req-c45bf8c9-8995-4990-ae62-7f6294cd98a1 None None] Registered counter for database nova_cell0 Aug 26 00:52:58.074968 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO dbcounter [None req-c45bf8c9-8995-4990-ae62-7f6294cd98a1 None None] Registered counter for database nova_cell1 Aug 26 00:52:58.082543 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_db.sqlalchemy.engines [None req-c45bf8c9-8995-4990-ae62-7f6294cd98a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127565) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 00:52:58.084833 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_db.sqlalchemy.engines [None req-c45bf8c9-8995-4990-ae62-7f6294cd98a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127565) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 00:52:58.088549 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.context [None req-be9880ae-bf64-4dc2-aa0a-60e316315773 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a(cell1) {{(pid=127564) load_cells /opt/stack/nova/nova/context.py:464}} Aug 26 00:52:58.089872 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writer thread running {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 00:52:58.093061 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-be9880ae-bf64-4dc2-aa0a-60e316315773 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:52:58.093796 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-be9880ae-bf64-4dc2-aa0a-60e316315773 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:52:58.096183 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-be9880ae-bf64-4dc2-aa0a-60e316315773 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:52:58.096564 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-be9880ae-bf64-4dc2-aa0a-60e316315773 None None] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:52:58.097127 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-be9880ae-bf64-4dc2-aa0a-60e316315773 None None] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:52:58.099236 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-be9880ae-bf64-4dc2-aa0a-60e316315773 None None] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:52:58.101977 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO dbcounter [None req-be9880ae-bf64-4dc2-aa0a-60e316315773 None None] Registered counter for database nova_cell0 Aug 26 00:52:58.106333 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO dbcounter [None req-be9880ae-bf64-4dc2-aa0a-60e316315773 None None] Registered counter for database nova_cell1 Aug 26 00:52:58.113783 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_db.sqlalchemy.engines [None req-be9880ae-bf64-4dc2-aa0a-60e316315773 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127564) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 00:52:58.116783 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_db.sqlalchemy.engines [None req-be9880ae-bf64-4dc2-aa0a-60e316315773 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127564) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 00:52:58.125043 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writer thread running {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 00:52:58.125632 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writer thread running {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 00:52:58.230420 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writer thread running {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 00:52:58.240337 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO dbcounter [None req-c45bf8c9-8995-4990-ae62-7f6294cd98a1 None None] Registered counter for database nova_cell0 Aug 26 00:52:58.247363 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_db.sqlalchemy.engines [None req-c45bf8c9-8995-4990-ae62-7f6294cd98a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127565) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 00:52:58.251921 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writer thread running {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 00:52:58.274914 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO dbcounter [None req-be9880ae-bf64-4dc2-aa0a-60e316315773 None None] Registered counter for database nova_cell0 Aug 26 00:52:58.283432 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_db.sqlalchemy.engines [None req-be9880ae-bf64-4dc2-aa0a-60e316315773 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127564) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 00:52:58.288623 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writer thread running {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 00:52:58.564701 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: WARNING keystonemiddleware.auth_token [None req-c45bf8c9-8995-4990-ae62-7f6294cd98a1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 26 00:52:58.572602 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: WARNING keystonemiddleware.auth_token [None req-c45bf8c9-8995-4990-ae62-7f6294cd98a1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 26 00:52:58.605493 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: WARNING keystonemiddleware.auth_token [None req-be9880ae-bf64-4dc2-aa0a-60e316315773 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 26 00:52:58.612733 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: WARNING keystonemiddleware.auth_token [None req-be9880ae-bf64-4dc2-aa0a-60e316315773 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 26 00:52:58.920902 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: WARNING keystonemiddleware.auth_token [None req-c45bf8c9-8995-4990-ae62-7f6294cd98a1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 26 00:52:58.927018 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: WARNING keystonemiddleware.auth_token [None req-c45bf8c9-8995-4990-ae62-7f6294cd98a1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 26 00:52:58.932439 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555a717779c0 pid: 127565 (default app) Aug 26 00:52:58.956203 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: WARNING keystonemiddleware.auth_token [None req-be9880ae-bf64-4dc2-aa0a-60e316315773 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 26 00:52:58.962777 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: WARNING keystonemiddleware.auth_token [None req-be9880ae-bf64-4dc2-aa0a-60e316315773 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 26 00:52:58.968041 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555a717779c0 pid: 127564 (default app) Aug 26 00:53:37.366762 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_api:SELECT=3 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:37.372686 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell0:SELECT=3 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:37.372686 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell1:SELECT=3 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:37.373363 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell0:SELECT=3 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:38.483501 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-ae516a8a-b728-43cc-ab9e-578b84ecca71 tempest-VolumesNegativeTest-516230065 tempest-VolumesNegativeTest-516230065-project] Action: 'create', calling method: .version_select at 0x7f8a93dc59d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1604736670", "metadata": {"Type": "work"}}} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:53:38.492072 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-ae516a8a-b728-43cc-ab9e-578b84ecca71 tempest-VolumesNegativeTest-516230065 tempest-VolumesNegativeTest-516230065-project] Request method failure captured: Aug 26 00:53:38.492072 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 26 00:53:38.492072 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Accept: application/json Aug 26 00:53:38.492072 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Accept-Encoding: identity Aug 26 00:53:38.492072 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Connection: close Aug 26 00:53:38.492072 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Content-Length: 122 Aug 26 00:53:38.492072 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Content-Type: application/json Aug 26 00:53:38.492072 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Host: 10.222.0.59 Aug 26 00:53:38.492072 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Openstack-System-Scope: None Aug 26 00:53:38.492072 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: User-Agent: python-urllib3/1.26.11 Aug 26 00:53:38.492072 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Auth-Token: gAAAAABjCBmRzFTTybGWXa8pKTItPnhTUIhtvsJLE6gXpWS9ms_PluMjlx2S1mTd9A-Aijg4KNx4JUoTtg_tAa6rDRAkMvl1OA6WyjhNtivBoA8NNndXtlMICAokBGYlM0DKlFtPd2-YyDGA84P20Guib3impaevViPn5rV90oqBwSF87vDtBcs Aug 26 00:53:38.492072 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Domain-Id: None Aug 26 00:53:38.492072 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Domain-Name: None Aug 26 00:53:38.492072 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Identity-Status: Confirmed Aug 26 00:53:38.492072 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Is-Admin-Project: True Aug 26 00:53:38.492072 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Domain-Id: default Aug 26 00:53:38.492072 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Domain-Name: Default Aug 26 00:53:38.492072 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Id: bd196a920ed04c0bac853f0556b4233d Aug 26 00:53:38.492072 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Name: tempest-VolumesNegativeTest-516230065 Aug 26 00:53:38.492072 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Role: reader,member Aug 26 00:53:38.492072 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Roles: reader,member Aug 26 00:53:38.493424 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_bd196a920ed04c0bac853f0556b4233d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bd196a920ed04c0bac853f0556b4233d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bd196a920ed04c0bac853f0556b4233d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/bd196a920ed04c0bac853f0556b4233d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 00:53:38.493424 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant: tempest-VolumesNegativeTest-516230065 Aug 26 00:53:38.493424 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant-Id: bd196a920ed04c0bac853f0556b4233d Aug 26 00:53:38.493424 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant-Name: tempest-VolumesNegativeTest-516230065 Aug 26 00:53:38.493424 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User: tempest-VolumesNegativeTest-516230065-project Aug 26 00:53:38.493424 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Domain-Id: default Aug 26 00:53:38.493424 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Domain-Name: Default Aug 26 00:53:38.493424 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Id: 5e69fd17e416401e84aa51537eed540f Aug 26 00:53:38.493424 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Name: tempest-VolumesNegativeTest-516230065-project Aug 26 00:53:38.493424 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Aug 26 00:53:38.493424 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1604736670", "metadata": {"Type": "work"}}} Aug 26 00:53:38.493424 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: method: Aug 26 00:53:38.493424 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 26 00:53:38.494258 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1604736670', 'metadata': {'Type': 'work'}}}} Aug 26 00:53:38.494258 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 00:53:38.494258 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:53:38.494258 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 26 00:53:38.494258 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 26 00:53:38.494258 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 26 00:53:38.494258 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise error Aug 26 00:53:38.494258 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 26 00:53:38.494258 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:53:38.494258 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 26 00:53:38.494258 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 26 00:53:38.494258 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:53:38.494258 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 26 00:53:38.494258 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi '#$%' Aug 26 00:53:38.494258 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:53:38.494258 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 00:53:38.494258 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:53:38.494258 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:53:38.494258 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 00:53:38.494258 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 00:53:38.494258 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 00:53:38.494258 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 00:53:38.495916 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 00:53:38.495916 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 00:53:38.495916 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 00:53:38.495916 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 00:53:38.495916 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 26 00:53:38.495916 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 26 00:53:38.495916 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 26 00:53:38.495916 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 26 00:53:38.495916 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 26 00:53:38.495916 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 26 00:53:38.495916 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 26 00:53:38.495916 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:53:38.495916 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 00:53:38.495916 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:53:38.495916 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:53:38.495916 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 00:53:38.495916 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 00:53:38.495916 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 26 00:53:38.495916 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 26 00:53:38.497071 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 26 00:53:38.497071 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:53:38.497071 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-ae516a8a-b728-43cc-ab9e-578b84ecca71 tempest-VolumesNegativeTest-516230065 tempest-VolumesNegativeTest-516230065-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 00:53:38.497071 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-ae516a8a-b728-43cc-ab9e-578b84ecca71 tempest-VolumesNegativeTest-516230065 tempest-VolumesNegativeTest-516230065-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.145616 Aug 26 00:53:38.497071 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 1/1] 10.222.0.59 () {60 vars in 1156 bytes} [Fri Aug 26 00:53:37 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1148 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 26 00:53:38.857110 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-2c09343e-38bc-4390-8630-5c000cc57353 tempest-VolumesNegativeTest-516230065 tempest-VolumesNegativeTest-516230065-project] Action: 'create', calling method: .version_select at 0x7f8a93ef34c0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1350244803", "metadata": {"Type": "work"}}} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:53:38.863950 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-2c09343e-38bc-4390-8630-5c000cc57353 tempest-VolumesNegativeTest-516230065 tempest-VolumesNegativeTest-516230065-project] Request method failure captured: Aug 26 00:53:38.863950 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 26 00:53:38.863950 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Accept: application/json Aug 26 00:53:38.863950 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Accept-Encoding: identity Aug 26 00:53:38.863950 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Connection: close Aug 26 00:53:38.863950 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Content-Length: 120 Aug 26 00:53:38.863950 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Content-Type: application/json Aug 26 00:53:38.863950 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Host: 10.222.0.59 Aug 26 00:53:38.863950 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Openstack-System-Scope: None Aug 26 00:53:38.863950 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: User-Agent: python-urllib3/1.26.11 Aug 26 00:53:38.863950 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Auth-Token: gAAAAABjCBmRzFTTybGWXa8pKTItPnhTUIhtvsJLE6gXpWS9ms_PluMjlx2S1mTd9A-Aijg4KNx4JUoTtg_tAa6rDRAkMvl1OA6WyjhNtivBoA8NNndXtlMICAokBGYlM0DKlFtPd2-YyDGA84P20Guib3impaevViPn5rV90oqBwSF87vDtBcs Aug 26 00:53:38.863950 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Domain-Id: None Aug 26 00:53:38.863950 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Domain-Name: None Aug 26 00:53:38.863950 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Identity-Status: Confirmed Aug 26 00:53:38.863950 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Is-Admin-Project: True Aug 26 00:53:38.863950 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Domain-Id: default Aug 26 00:53:38.863950 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Domain-Name: Default Aug 26 00:53:38.863950 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Id: bd196a920ed04c0bac853f0556b4233d Aug 26 00:53:38.863950 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Name: tempest-VolumesNegativeTest-516230065 Aug 26 00:53:38.863950 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Role: reader,member Aug 26 00:53:38.863950 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Roles: reader,member Aug 26 00:53:38.876855 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_bd196a920ed04c0bac853f0556b4233d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bd196a920ed04c0bac853f0556b4233d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bd196a920ed04c0bac853f0556b4233d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/bd196a920ed04c0bac853f0556b4233d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 00:53:38.876855 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant: tempest-VolumesNegativeTest-516230065 Aug 26 00:53:38.876855 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant-Id: bd196a920ed04c0bac853f0556b4233d Aug 26 00:53:38.876855 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant-Name: tempest-VolumesNegativeTest-516230065 Aug 26 00:53:38.876855 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User: tempest-VolumesNegativeTest-516230065-project Aug 26 00:53:38.876855 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Domain-Id: default Aug 26 00:53:38.876855 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Domain-Name: Default Aug 26 00:53:38.876855 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Id: 5e69fd17e416401e84aa51537eed540f Aug 26 00:53:38.876855 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Name: tempest-VolumesNegativeTest-516230065-project Aug 26 00:53:38.876855 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Aug 26 00:53:38.876855 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1350244803", "metadata": {"Type": "work"}}} Aug 26 00:53:38.876855 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: method: Aug 26 00:53:38.876855 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 26 00:53:38.878126 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1350244803', 'metadata': {'Type': 'work'}}}} Aug 26 00:53:38.878126 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 00:53:38.878126 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:53:38.878126 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 26 00:53:38.878126 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 26 00:53:38.878126 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 26 00:53:38.878126 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise error Aug 26 00:53:38.878126 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 26 00:53:38.878126 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 00:53:38.878126 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 26 00:53:38.878126 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 26 00:53:38.878126 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 00:53:38.878126 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 26 00:53:38.878126 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi '0' Aug 26 00:53:38.878126 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 00:53:38.878126 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 00:53:38.878126 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 00:53:38.878126 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:53:38.878126 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 00:53:38.878126 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 00:53:38.878126 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 00:53:38.878126 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 00:53:38.879743 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 00:53:38.879743 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 00:53:38.879743 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 00:53:38.879743 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 00:53:38.879743 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 26 00:53:38.879743 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 26 00:53:38.879743 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 26 00:53:38.879743 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 26 00:53:38.879743 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 26 00:53:38.879743 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 26 00:53:38.879743 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 26 00:53:38.879743 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 00:53:38.879743 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 00:53:38.879743 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 00:53:38.879743 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:53:38.879743 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 00:53:38.879743 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 00:53:38.879743 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 26 00:53:38.879743 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 26 00:53:38.883769 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 26 00:53:38.883769 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 00:53:38.883769 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-2c09343e-38bc-4390-8630-5c000cc57353 tempest-VolumesNegativeTest-516230065 tempest-VolumesNegativeTest-516230065-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 00:53:38.883769 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-2c09343e-38bc-4390-8630-5c000cc57353 tempest-VolumesNegativeTest-516230065 tempest-VolumesNegativeTest-516230065-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.365807 Aug 26 00:53:38.883769 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 1/2] 10.222.0.59 () {60 vars in 1156 bytes} [Fri Aug 26 00:53:38 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 368 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 26 00:53:38.884931 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-6d2d6c94-524f-42b3-96b8-af4c261139dc tempest-VolumesNegativeTest-516230065 tempest-VolumesNegativeTest-516230065-project] Action: 'create', calling method: .version_select at 0x7f8a93dc5a60>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1842466815", "metadata": {"Type": "work"}}} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:53:38.886203 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-6d2d6c94-524f-42b3-96b8-af4c261139dc tempest-VolumesNegativeTest-516230065 tempest-VolumesNegativeTest-516230065-project] Request method failure captured: Aug 26 00:53:38.886203 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 26 00:53:38.886203 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Accept: application/json Aug 26 00:53:38.886203 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Accept-Encoding: identity Aug 26 00:53:38.886203 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Connection: close Aug 26 00:53:38.886203 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Content-Length: 119 Aug 26 00:53:38.886203 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Content-Type: application/json Aug 26 00:53:38.886203 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Host: 10.222.0.59 Aug 26 00:53:38.886203 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Openstack-System-Scope: None Aug 26 00:53:38.886203 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: User-Agent: python-urllib3/1.26.11 Aug 26 00:53:38.886203 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Auth-Token: gAAAAABjCBmRzFTTybGWXa8pKTItPnhTUIhtvsJLE6gXpWS9ms_PluMjlx2S1mTd9A-Aijg4KNx4JUoTtg_tAa6rDRAkMvl1OA6WyjhNtivBoA8NNndXtlMICAokBGYlM0DKlFtPd2-YyDGA84P20Guib3impaevViPn5rV90oqBwSF87vDtBcs Aug 26 00:53:38.886203 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Domain-Id: None Aug 26 00:53:38.886203 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Domain-Name: None Aug 26 00:53:38.886203 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Identity-Status: Confirmed Aug 26 00:53:38.886203 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Is-Admin-Project: True Aug 26 00:53:38.886203 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Domain-Id: default Aug 26 00:53:38.886203 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Domain-Name: Default Aug 26 00:53:38.886203 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Id: bd196a920ed04c0bac853f0556b4233d Aug 26 00:53:38.886203 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Name: tempest-VolumesNegativeTest-516230065 Aug 26 00:53:38.886203 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Role: reader,member Aug 26 00:53:38.886203 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Roles: reader,member Aug 26 00:53:38.894497 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_bd196a920ed04c0bac853f0556b4233d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bd196a920ed04c0bac853f0556b4233d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bd196a920ed04c0bac853f0556b4233d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/bd196a920ed04c0bac853f0556b4233d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 00:53:38.894497 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant: tempest-VolumesNegativeTest-516230065 Aug 26 00:53:38.894497 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant-Id: bd196a920ed04c0bac853f0556b4233d Aug 26 00:53:38.894497 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant-Name: tempest-VolumesNegativeTest-516230065 Aug 26 00:53:38.894497 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User: tempest-VolumesNegativeTest-516230065-project Aug 26 00:53:38.894497 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Domain-Id: default Aug 26 00:53:38.894497 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Domain-Name: Default Aug 26 00:53:38.894497 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Id: 5e69fd17e416401e84aa51537eed540f Aug 26 00:53:38.894497 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Name: tempest-VolumesNegativeTest-516230065-project Aug 26 00:53:38.894497 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Aug 26 00:53:38.894497 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1842466815", "metadata": {"Type": "work"}}} Aug 26 00:53:38.894497 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: method: Aug 26 00:53:38.894497 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 26 00:53:38.896821 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1842466815', 'metadata': {'Type': 'work'}}}} Aug 26 00:53:38.896821 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 00:53:38.896821 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:53:38.896821 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 26 00:53:38.896821 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 26 00:53:38.896821 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 26 00:53:38.896821 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise error Aug 26 00:53:38.896821 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 26 00:53:38.896821 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:53:38.896821 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 26 00:53:38.896821 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 26 00:53:38.896821 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:53:38.896821 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 26 00:53:38.896821 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi '' Aug 26 00:53:38.896821 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:53:38.896821 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 00:53:38.896821 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:53:38.896821 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:53:38.896821 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 00:53:38.896821 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 00:53:38.896821 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 00:53:38.896821 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 00:53:38.902846 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 00:53:38.902846 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 00:53:38.902846 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 00:53:38.902846 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 00:53:38.902846 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 26 00:53:38.902846 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 26 00:53:38.902846 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 26 00:53:38.902846 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 26 00:53:38.902846 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 26 00:53:38.902846 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 26 00:53:38.902846 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 26 00:53:38.902846 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:53:38.902846 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 00:53:38.902846 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:53:38.902846 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:53:38.902846 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 00:53:38.902846 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 00:53:38.902846 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 26 00:53:38.902846 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 26 00:53:38.904058 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 26 00:53:38.904058 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:53:38.904058 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-6d2d6c94-524f-42b3-96b8-af4c261139dc tempest-VolumesNegativeTest-516230065 tempest-VolumesNegativeTest-516230065-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 00:53:38.904058 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-6d2d6c94-524f-42b3-96b8-af4c261139dc tempest-VolumesNegativeTest-516230065 tempest-VolumesNegativeTest-516230065-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010615 Aug 26 00:53:38.904058 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 2/3] 10.222.0.59 () {60 vars in 1156 bytes} [Fri Aug 26 00:53:38 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 26 00:53:38.904404 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-3ef53564-aa2f-4e39-a756-cad300909815 tempest-VolumesNegativeTest-516230065 tempest-VolumesNegativeTest-516230065-project] Calling method '.version_select at 0x7f8a93e06f70>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:53:38.939847 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_api:SELECT=3 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:38.941186 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell1:SELECT=3 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:38.941944 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell0:SELECT=3 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:38.942822 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell0:SELECT=3 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:39.343160 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.wsgi [None req-3ef53564-aa2f-4e39-a756-cad300909815 tempest-VolumesNegativeTest-516230065 tempest-VolumesNegativeTest-516230065-project] HTTP exception thrown: Volume tempest-invalid-280307661 could not be found. Aug 26 00:53:39.347393 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-3ef53564-aa2f-4e39-a756-cad300909815 tempest-VolumesNegativeTest-516230065 tempest-VolumesNegativeTest-516230065-project] Request method failure captured: Aug 26 00:53:39.347393 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-280307661 HTTP/1.1 Aug 26 00:53:39.347393 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Accept: application/json Aug 26 00:53:39.347393 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Accept-Encoding: identity Aug 26 00:53:39.347393 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Connection: close Aug 26 00:53:39.347393 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Content-Length: 0 Aug 26 00:53:39.347393 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Content-Type: application/json Aug 26 00:53:39.347393 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Host: 10.222.0.59 Aug 26 00:53:39.347393 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Openstack-System-Scope: None Aug 26 00:53:39.347393 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: User-Agent: python-urllib3/1.26.11 Aug 26 00:53:39.347393 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Auth-Token: gAAAAABjCBmRzFTTybGWXa8pKTItPnhTUIhtvsJLE6gXpWS9ms_PluMjlx2S1mTd9A-Aijg4KNx4JUoTtg_tAa6rDRAkMvl1OA6WyjhNtivBoA8NNndXtlMICAokBGYlM0DKlFtPd2-YyDGA84P20Guib3impaevViPn5rV90oqBwSF87vDtBcs Aug 26 00:53:39.347393 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Domain-Id: None Aug 26 00:53:39.347393 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Domain-Name: None Aug 26 00:53:39.347393 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Identity-Status: Confirmed Aug 26 00:53:39.347393 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Is-Admin-Project: True Aug 26 00:53:39.347393 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Domain-Id: default Aug 26 00:53:39.347393 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Domain-Name: Default Aug 26 00:53:39.347393 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Id: bd196a920ed04c0bac853f0556b4233d Aug 26 00:53:39.347393 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Name: tempest-VolumesNegativeTest-516230065 Aug 26 00:53:39.347393 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Role: reader,member Aug 26 00:53:39.347393 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Roles: reader,member Aug 26 00:53:39.348932 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_bd196a920ed04c0bac853f0556b4233d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bd196a920ed04c0bac853f0556b4233d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bd196a920ed04c0bac853f0556b4233d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/bd196a920ed04c0bac853f0556b4233d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 00:53:39.348932 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant: tempest-VolumesNegativeTest-516230065 Aug 26 00:53:39.348932 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant-Id: bd196a920ed04c0bac853f0556b4233d Aug 26 00:53:39.348932 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant-Name: tempest-VolumesNegativeTest-516230065 Aug 26 00:53:39.348932 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User: tempest-VolumesNegativeTest-516230065-project Aug 26 00:53:39.348932 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Domain-Id: default Aug 26 00:53:39.348932 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Domain-Name: Default Aug 26 00:53:39.348932 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Id: 5e69fd17e416401e84aa51537eed540f Aug 26 00:53:39.348932 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Name: tempest-VolumesNegativeTest-516230065-project Aug 26 00:53:39.348932 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: method: Aug 26 00:53:39.348932 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: exception: Volume tempest-invalid-280307661 could not be found. Aug 26 00:53:39.348932 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: action_args: {'id': 'tempest-invalid-280307661'} Aug 26 00:53:39.348932 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 00:53:39.349820 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:53:39.349820 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 00:53:39.349820 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 00:53:39.349820 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 26 00:53:39.349820 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 26 00:53:39.349820 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 26 00:53:39.349820 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 26 00:53:39.349820 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 26 00:53:39.349820 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 26 00:53:39.349820 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 26 00:53:39.349820 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 26 00:53:39.349820 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 00:53:39.349820 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 00:53:39.349820 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 00:53:39.349820 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 00:53:39.349820 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-280307661 could not be found. (HTTP 404) (Request-ID: req-c39707cd-00d6-4199-9060-db192b6a898b) Aug 26 00:53:39.349820 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 00:53:39.349820 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 00:53:39.349820 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 00:53:39.351331 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:53:39.351331 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 26 00:53:39.351331 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 26 00:53:39.351331 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 26 00:53:39.351331 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 26 00:53:39.351331 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 26 00:53:39.351331 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 26 00:53:39.351331 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 26 00:53:39.351331 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 26 00:53:39.351331 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 00:53:39.351331 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 00:53:39.351331 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 26 00:53:39.351331 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 26 00:53:39.351331 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 26 00:53:39.351331 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 26 00:53:39.351331 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 26 00:53:39.351331 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 26 00:53:39.351331 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 26 00:53:39.351331 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 26 00:53:39.587743 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 00:53:39.587743 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 00:53:39.587743 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 00:53:39.587743 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 00:53:39.587743 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-280307661 could not be found. Aug 26 00:53:39.587743 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 00:53:39.587743 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 00:53:39.587743 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 00:53:39.587743 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:53:39.587743 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 00:53:39.587743 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 00:53:39.587743 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 00:53:39.587743 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 00:53:39.587743 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 00:53:39.587743 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 00:53:39.587743 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 00:53:39.587743 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 00:53:39.587743 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 26 00:53:39.587743 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 00:53:39.587743 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-280307661 could not be found. Aug 26 00:53:39.618183 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 00:53:39.618183 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 00:53:39.618183 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 00:53:39.618183 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:53:39.618183 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 00:53:39.618183 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 00:53:39.618183 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 00:53:39.618183 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 00:53:39.618183 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-280307661 could not be found. Aug 26 00:53:39.618183 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 00:53:39.618183 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-3ef53564-aa2f-4e39-a756-cad300909815 tempest-VolumesNegativeTest-516230065 tempest-VolumesNegativeTest-516230065-project] Returning 404 to user: Volume tempest-invalid-280307661 could not be found. {{(pid=127564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 00:53:39.618183 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-3ef53564-aa2f-4e39-a756-cad300909815 tempest-VolumesNegativeTest-516230065 tempest-VolumesNegativeTest-516230065-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/tempest-invalid-280307661" status: 404 len: 98 microversion: 2.1 time: 0.453983 Aug 26 00:53:39.618183 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 2/4] 10.222.0.59 () {58 vars in 1215 bytes} [Fri Aug 26 00:53:38 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-280307661 => generated 98 bytes in 461 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 26 00:53:39.624181 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-da751ed8-dbc2-432b-8096-5d52f78dc206 tempest-VolumesNegativeTest-516230065 tempest-VolumesNegativeTest-516230065-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003742 Aug 26 00:53:39.624181 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 3/5] 10.222.0.59 () {58 vars in 1140 bytes} [Fri Aug 26 00:53:39 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 26 00:53:39.626062 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-4727695b-3251-4de5-915f-d13baacb9731 tempest-VolumesNegativeTest-516230065 tempest-VolumesNegativeTest-516230065-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004231 Aug 26 00:53:39.626062 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 3/6] 10.222.0.59 () {58 vars in 1137 bytes} [Fri Aug 26 00:53:39 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 26 00:53:39.627685 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-ad9a1ccb-2206-4743-a809-ca2d73c5ef7e tempest-VolumesNegativeTest-516230065 tempest-VolumesNegativeTest-516230065-project] Calling method '.version_select at 0x7f8a93c7d820>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:53:39.643721 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.wsgi [None req-ad9a1ccb-2206-4743-a809-ca2d73c5ef7e tempest-VolumesNegativeTest-516230065 tempest-VolumesNegativeTest-516230065-project] HTTP exception thrown: Volume ad75c5f0-be14-4a94-bf76-adf663d11117 could not be found. Aug 26 00:53:39.647622 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-ad9a1ccb-2206-4743-a809-ca2d73c5ef7e tempest-VolumesNegativeTest-516230065 tempest-VolumesNegativeTest-516230065-project] Request method failure captured: Aug 26 00:53:39.647622 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: request: DELETE /compute/v2.1/os-volumes/ad75c5f0-be14-4a94-bf76-adf663d11117 HTTP/1.1 Aug 26 00:53:39.647622 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Accept: application/json Aug 26 00:53:39.647622 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Accept-Encoding: identity Aug 26 00:53:39.647622 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Connection: close Aug 26 00:53:39.647622 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Content-Length: 0 Aug 26 00:53:39.647622 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Content-Type: application/json Aug 26 00:53:39.647622 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Host: 10.222.0.59 Aug 26 00:53:39.647622 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Openstack-System-Scope: None Aug 26 00:53:39.647622 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: User-Agent: python-urllib3/1.26.11 Aug 26 00:53:39.647622 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Auth-Token: gAAAAABjCBmRzFTTybGWXa8pKTItPnhTUIhtvsJLE6gXpWS9ms_PluMjlx2S1mTd9A-Aijg4KNx4JUoTtg_tAa6rDRAkMvl1OA6WyjhNtivBoA8NNndXtlMICAokBGYlM0DKlFtPd2-YyDGA84P20Guib3impaevViPn5rV90oqBwSF87vDtBcs Aug 26 00:53:39.647622 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Domain-Id: None Aug 26 00:53:39.647622 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Domain-Name: None Aug 26 00:53:39.647622 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Identity-Status: Confirmed Aug 26 00:53:39.647622 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Is-Admin-Project: True Aug 26 00:53:39.647622 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Domain-Id: default Aug 26 00:53:39.647622 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Domain-Name: Default Aug 26 00:53:39.647622 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Id: bd196a920ed04c0bac853f0556b4233d Aug 26 00:53:39.647622 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Name: tempest-VolumesNegativeTest-516230065 Aug 26 00:53:39.647622 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Role: reader,member Aug 26 00:53:39.647622 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Roles: reader,member Aug 26 00:53:39.649011 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_bd196a920ed04c0bac853f0556b4233d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bd196a920ed04c0bac853f0556b4233d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bd196a920ed04c0bac853f0556b4233d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/bd196a920ed04c0bac853f0556b4233d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 00:53:39.649011 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant: tempest-VolumesNegativeTest-516230065 Aug 26 00:53:39.649011 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant-Id: bd196a920ed04c0bac853f0556b4233d Aug 26 00:53:39.649011 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant-Name: tempest-VolumesNegativeTest-516230065 Aug 26 00:53:39.649011 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User: tempest-VolumesNegativeTest-516230065-project Aug 26 00:53:39.649011 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Domain-Id: default Aug 26 00:53:39.649011 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Domain-Name: Default Aug 26 00:53:39.649011 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Id: 5e69fd17e416401e84aa51537eed540f Aug 26 00:53:39.649011 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Name: tempest-VolumesNegativeTest-516230065-project Aug 26 00:53:39.649011 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: method: Aug 26 00:53:39.649011 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: exception: Volume ad75c5f0-be14-4a94-bf76-adf663d11117 could not be found. Aug 26 00:53:39.649011 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: action_args: {'id': 'ad75c5f0-be14-4a94-bf76-adf663d11117'} Aug 26 00:53:39.649011 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 00:53:39.650765 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:53:39.650765 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 00:53:39.650765 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 00:53:39.650765 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 26 00:53:39.650765 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 26 00:53:39.650765 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 26 00:53:39.650765 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 26 00:53:39.650765 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 26 00:53:39.650765 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 26 00:53:39.650765 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 26 00:53:39.650765 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 26 00:53:39.650765 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 00:53:39.650765 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 00:53:39.650765 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 00:53:39.650765 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 00:53:39.650765 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ad75c5f0-be14-4a94-bf76-adf663d11117 could not be found. (HTTP 404) (Request-ID: req-50123543-d819-400d-8bd2-dd6f9274fb97) Aug 26 00:53:39.650765 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:53:39.650765 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 00:53:39.650765 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:53:39.652345 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:53:39.652345 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 26 00:53:39.652345 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 26 00:53:39.652345 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 26 00:53:39.652345 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 26 00:53:39.652345 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 26 00:53:39.652345 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 26 00:53:39.652345 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 26 00:53:39.652345 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 26 00:53:39.652345 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 00:53:39.652345 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 00:53:39.652345 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 26 00:53:39.652345 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 26 00:53:39.652345 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 26 00:53:39.652345 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 26 00:53:39.652345 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 26 00:53:39.652345 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 26 00:53:39.652345 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 26 00:53:39.652345 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 26 00:53:39.654445 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 00:53:39.654445 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 00:53:39.654445 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 00:53:39.654445 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 00:53:39.654445 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ad75c5f0-be14-4a94-bf76-adf663d11117 could not be found. Aug 26 00:53:39.654445 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:53:39.654445 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 00:53:39.654445 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:53:39.654445 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:53:39.654445 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 00:53:39.654445 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 00:53:39.654445 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 00:53:39.654445 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 00:53:39.654445 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 00:53:39.654445 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 00:53:39.654445 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 00:53:39.654445 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 00:53:39.654445 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 26 00:53:39.654445 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 00:53:39.656185 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ad75c5f0-be14-4a94-bf76-adf663d11117 could not be found. Aug 26 00:53:39.656185 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:53:39.656185 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 00:53:39.656185 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:53:39.656185 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:53:39.656185 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 00:53:39.656185 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 00:53:39.656185 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 00:53:39.656185 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 00:53:39.656185 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ad75c5f0-be14-4a94-bf76-adf663d11117 could not be found. Aug 26 00:53:39.656185 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:53:39.656185 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-ad9a1ccb-2206-4743-a809-ca2d73c5ef7e tempest-VolumesNegativeTest-516230065 tempest-VolumesNegativeTest-516230065-project] Returning 404 to user: Volume ad75c5f0-be14-4a94-bf76-adf663d11117 could not be found. {{(pid=127565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 00:53:39.656185 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-ad9a1ccb-2206-4743-a809-ca2d73c5ef7e tempest-VolumesNegativeTest-516230065 tempest-VolumesNegativeTest-516230065-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/ad75c5f0-be14-4a94-bf76-adf663d11117" status: 404 len: 109 microversion: 2.1 time: 0.267598 Aug 26 00:53:39.656185 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 4/7] 10.222.0.59 () {58 vars in 1248 bytes} [Fri Aug 26 00:53:39 2022] DELETE /compute/v2.1/os-volumes/ad75c5f0-be14-4a94-bf76-adf663d11117 => generated 109 bytes in 269 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 00:53:39.662265 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-bfb9f891-90f6-48b9-9ad5-fcff111331b8 tempest-VolumesNegativeTest-516230065 tempest-VolumesNegativeTest-516230065-project] Calling method '.version_select at 0x7f8a93c288b0>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:53:39.694308 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.wsgi [None req-bfb9f891-90f6-48b9-9ad5-fcff111331b8 tempest-VolumesNegativeTest-516230065 tempest-VolumesNegativeTest-516230065-project] HTTP exception thrown: Volume bad1347d-202b-410f-81a2-f5bae38476a3 could not be found. Aug 26 00:53:39.698166 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-bfb9f891-90f6-48b9-9ad5-fcff111331b8 tempest-VolumesNegativeTest-516230065 tempest-VolumesNegativeTest-516230065-project] Request method failure captured: Aug 26 00:53:39.698166 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: request: GET /compute/v2.1/os-volumes/bad1347d-202b-410f-81a2-f5bae38476a3 HTTP/1.1 Aug 26 00:53:39.698166 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Accept: application/json Aug 26 00:53:39.698166 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Accept-Encoding: identity Aug 26 00:53:39.698166 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Connection: close Aug 26 00:53:39.698166 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Content-Length: 0 Aug 26 00:53:39.698166 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Content-Type: application/json Aug 26 00:53:39.698166 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Host: 10.222.0.59 Aug 26 00:53:39.698166 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Openstack-System-Scope: None Aug 26 00:53:39.698166 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: User-Agent: python-urllib3/1.26.11 Aug 26 00:53:39.698166 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Auth-Token: gAAAAABjCBmRzFTTybGWXa8pKTItPnhTUIhtvsJLE6gXpWS9ms_PluMjlx2S1mTd9A-Aijg4KNx4JUoTtg_tAa6rDRAkMvl1OA6WyjhNtivBoA8NNndXtlMICAokBGYlM0DKlFtPd2-YyDGA84P20Guib3impaevViPn5rV90oqBwSF87vDtBcs Aug 26 00:53:39.698166 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Domain-Id: None Aug 26 00:53:39.698166 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Domain-Name: None Aug 26 00:53:39.698166 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Identity-Status: Confirmed Aug 26 00:53:39.698166 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Is-Admin-Project: True Aug 26 00:53:39.698166 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Domain-Id: default Aug 26 00:53:39.698166 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Domain-Name: Default Aug 26 00:53:39.698166 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Id: bd196a920ed04c0bac853f0556b4233d Aug 26 00:53:39.698166 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Name: tempest-VolumesNegativeTest-516230065 Aug 26 00:53:39.698166 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Role: reader,member Aug 26 00:53:39.698166 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Roles: reader,member Aug 26 00:53:39.699422 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_bd196a920ed04c0bac853f0556b4233d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bd196a920ed04c0bac853f0556b4233d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bd196a920ed04c0bac853f0556b4233d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/bd196a920ed04c0bac853f0556b4233d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 00:53:39.699422 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant: tempest-VolumesNegativeTest-516230065 Aug 26 00:53:39.699422 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant-Id: bd196a920ed04c0bac853f0556b4233d Aug 26 00:53:39.699422 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant-Name: tempest-VolumesNegativeTest-516230065 Aug 26 00:53:39.699422 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User: tempest-VolumesNegativeTest-516230065-project Aug 26 00:53:39.699422 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Domain-Id: default Aug 26 00:53:39.699422 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Domain-Name: Default Aug 26 00:53:39.699422 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Id: 5e69fd17e416401e84aa51537eed540f Aug 26 00:53:39.699422 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Name: tempest-VolumesNegativeTest-516230065-project Aug 26 00:53:39.699422 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: method: Aug 26 00:53:39.699422 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: exception: Volume bad1347d-202b-410f-81a2-f5bae38476a3 could not be found. Aug 26 00:53:39.699422 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: action_args: {'id': 'bad1347d-202b-410f-81a2-f5bae38476a3'} Aug 26 00:53:39.699422 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 00:53:39.708191 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:53:39.708191 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 00:53:39.708191 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 00:53:39.708191 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 26 00:53:39.708191 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 26 00:53:39.708191 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 26 00:53:39.708191 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 26 00:53:39.708191 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 00:53:39.708191 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 00:53:39.708191 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 00:53:39.708191 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 00:53:39.708191 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 00:53:39.708191 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 00:53:39.708191 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 00:53:39.708191 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 00:53:39.708191 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bad1347d-202b-410f-81a2-f5bae38476a3 could not be found. (HTTP 404) (Request-ID: req-906b3a8e-8e59-451d-876a-57ff9d2860f1) Aug 26 00:53:39.708191 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 00:53:39.708191 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 00:53:39.708191 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 00:53:39.710357 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:53:39.710357 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 26 00:53:39.710357 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 26 00:53:39.710357 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 26 00:53:39.710357 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 26 00:53:39.710357 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 26 00:53:39.710357 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 26 00:53:39.710357 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 26 00:53:39.710357 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 26 00:53:39.710357 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 00:53:39.710357 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 00:53:39.710357 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 26 00:53:39.710357 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 26 00:53:39.710357 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 26 00:53:39.710357 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 26 00:53:39.710357 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 00:53:39.710357 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 00:53:39.710357 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 00:53:39.710357 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 00:53:39.711734 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 00:53:39.711734 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 00:53:39.711734 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 00:53:39.711734 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 00:53:39.711734 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bad1347d-202b-410f-81a2-f5bae38476a3 could not be found. Aug 26 00:53:39.711734 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 00:53:39.711734 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 00:53:39.711734 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 00:53:39.711734 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:53:39.711734 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 00:53:39.711734 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 00:53:39.711734 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 00:53:39.711734 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 00:53:39.711734 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 00:53:39.711734 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 00:53:39.711734 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 00:53:39.711734 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 00:53:39.711734 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 26 00:53:39.711734 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 00:53:39.717557 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bad1347d-202b-410f-81a2-f5bae38476a3 could not be found. Aug 26 00:53:39.717557 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 00:53:39.717557 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 00:53:39.717557 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 00:53:39.717557 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:53:39.717557 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 00:53:39.717557 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 00:53:39.717557 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 00:53:39.717557 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 00:53:39.717557 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bad1347d-202b-410f-81a2-f5bae38476a3 could not be found. Aug 26 00:53:39.717557 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 00:53:39.717557 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-bfb9f891-90f6-48b9-9ad5-fcff111331b8 tempest-VolumesNegativeTest-516230065 tempest-VolumesNegativeTest-516230065-project] Returning 404 to user: Volume bad1347d-202b-410f-81a2-f5bae38476a3 could not be found. {{(pid=127564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 00:53:39.717557 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-bfb9f891-90f6-48b9-9ad5-fcff111331b8 tempest-VolumesNegativeTest-516230065 tempest-VolumesNegativeTest-516230065-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/bad1347d-202b-410f-81a2-f5bae38476a3" status: 404 len: 109 microversion: 2.1 time: 0.042006 Aug 26 00:53:39.717557 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 4/8] 10.222.0.59 () {58 vars in 1245 bytes} [Fri Aug 26 00:53:39 2022] GET /compute/v2.1/os-volumes/bad1347d-202b-410f-81a2-f5bae38476a3 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 00:53:40.638129 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-b380e250-57a0-4acb-8abc-c01d72c346e1 tempest-VolumesTestJSON-1852121922 tempest-VolumesTestJSON-1852121922-project] Calling method '.version_select at 0x7f8a93c34430>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:53:40.746367 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-b380e250-57a0-4acb-8abc-c01d72c346e1 tempest-VolumesTestJSON-1852121922 tempest-VolumesTestJSON-1852121922-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/3dd95cac-b190-4c13-b6f3-638a01bde4bb" status: 200 len: 350 microversion: 2.1 time: 0.112295 Aug 26 00:53:40.747009 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 5/9] 10.222.0.59 () {58 vars in 1245 bytes} [Fri Aug 26 00:53:40 2022] GET /compute/v2.1/os-volumes/3dd95cac-b190-4c13-b6f3-638a01bde4bb => generated 350 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:53:43.307837 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-80889bdd-09f6-48bc-a788-1840b80e8545 tempest-VolumesTestJSON-1852121922 tempest-VolumesTestJSON-1852121922-project] Calling method '.version_select at 0x7f8a93c289d0>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:53:43.394537 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-80889bdd-09f6-48bc-a788-1840b80e8545 tempest-VolumesTestJSON-1852121922 tempest-VolumesTestJSON-1852121922-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/d4f02995-b9c5-48a9-a42a-a522f650d37f" status: 200 len: 350 microversion: 2.1 time: 0.091125 Aug 26 00:53:43.395589 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 5/10] 10.222.0.59 () {58 vars in 1245 bytes} [Fri Aug 26 00:53:43 2022] GET /compute/v2.1/os-volumes/d4f02995-b9c5-48a9-a42a-a522f650d37f => generated 350 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:53:45.626863 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-c5558765-9b9d-472f-8147-fb365c454f92 tempest-VolumesTestJSON-1852121922 tempest-VolumesTestJSON-1852121922-project] Calling method '.version_select at 0x7f8a93c34b80>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:53:45.747834 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-c5558765-9b9d-472f-8147-fb365c454f92 tempest-VolumesTestJSON-1852121922 tempest-VolumesTestJSON-1852121922-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/253abcbf-2e7d-48a0-8c91-2b5241d22c0d" status: 200 len: 351 microversion: 2.1 time: 0.124815 Aug 26 00:53:45.757815 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 6/11] 10.222.0.59 () {58 vars in 1245 bytes} [Fri Aug 26 00:53:45 2022] GET /compute/v2.1/os-volumes/253abcbf-2e7d-48a0-8c91-2b5241d22c0d => generated 351 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:53:45.763250 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-a3cbc962-7384-4ff8-a2cf-5f8d7007badd tempest-VolumesTestJSON-1852121922 tempest-VolumesTestJSON-1852121922-project] Calling method '.version_select at 0x7f8a93c283a0>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:53:45.917643 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-a3cbc962-7384-4ff8-a2cf-5f8d7007badd tempest-VolumesTestJSON-1852121922 tempest-VolumesTestJSON-1852121922-project] 10.222.0.59 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.158453 Aug 26 00:53:45.930111 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 6/12] 10.222.0.59 () {58 vars in 1134 bytes} [Fri Aug 26 00:53:45 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:53:45.936829 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-fdaaaffd-3c27-4e79-b44f-de87249baaef tempest-VolumesTestJSON-1852121922 tempest-VolumesTestJSON-1852121922-project] Calling method '.version_select at 0x7f8a93c34c10>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:53:46.090100 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-fdaaaffd-3c27-4e79-b44f-de87249baaef tempest-VolumesTestJSON-1852121922 tempest-VolumesTestJSON-1852121922-project] 10.222.0.59 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.158241 Aug 26 00:53:46.090833 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 7/13] 10.222.0.59 () {58 vars in 1149 bytes} [Fri Aug 26 00:53:45 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 00:53:46.110740 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-95908275-abc4-4f1a-8bd7-4c89fa80832a tempest-VolumesTestJSON-1852121922 tempest-VolumesTestJSON-1852121922-project] Calling method '.version_select at 0x7f8a93bbadc0>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:53:46.327658 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-95908275-abc4-4f1a-8bd7-4c89fa80832a tempest-VolumesTestJSON-1852121922 tempest-VolumesTestJSON-1852121922-project] 10.222.0.59 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.222461 Aug 26 00:53:46.344592 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 7/14] 10.222.0.59 () {58 vars in 1134 bytes} [Fri Aug 26 00:53:46 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:53:46.346277 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-202f2e95-31ae-46e4-86b1-73d255ac0f30 tempest-VolumesTestJSON-1852121922 tempest-VolumesTestJSON-1852121922-project] Calling method '.version_select at 0x7f8a93bc15e0>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:53:46.497081 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-202f2e95-31ae-46e4-86b1-73d255ac0f30 tempest-VolumesTestJSON-1852121922 tempest-VolumesTestJSON-1852121922-project] 10.222.0.59 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.156877 Aug 26 00:53:46.498623 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 8/15] 10.222.0.59 () {58 vars in 1167 bytes} [Fri Aug 26 00:53:46 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:53:46.513034 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-4ac7b10f-c6e8-42e1-a90f-a625af38b05c tempest-VolumesTestJSON-1852121922 tempest-VolumesTestJSON-1852121922-project] Calling method '.version_select at 0x7f8a93bbaa60>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:53:46.625135 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-4ac7b10f-c6e8-42e1-a90f-a625af38b05c tempest-VolumesTestJSON-1852121922 tempest-VolumesTestJSON-1852121922-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.116432 Aug 26 00:53:46.626424 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 8/16] 10.222.0.59 () {58 vars in 1170 bytes} [Fri Aug 26 00:53:46 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:53:46.645064 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-0c9d8a8b-1ceb-4e5f-946a-0d8f412dfbdd tempest-VolumesTestJSON-1852121922 tempest-VolumesTestJSON-1852121922-project] Calling method '.version_select at 0x7f8a93bc1d30>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:53:46.810420 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-0c9d8a8b-1ceb-4e5f-946a-0d8f412dfbdd tempest-VolumesTestJSON-1852121922 tempest-VolumesTestJSON-1852121922-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.170591 Aug 26 00:53:46.821565 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 9/17] 10.222.0.59 () {58 vars in 1155 bytes} [Fri Aug 26 00:53:46 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:53:46.825966 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-5d481961-34dd-4e26-916c-2b28fbb81907 tempest-VolumesTestJSON-1852121922 tempest-VolumesTestJSON-1852121922-project] Calling method '.version_select at 0x7f8a93c284c0>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:53:46.997191 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-5d481961-34dd-4e26-916c-2b28fbb81907 tempest-VolumesTestJSON-1852121922 tempest-VolumesTestJSON-1852121922-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.175907 Aug 26 00:53:46.998017 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 9/18] 10.222.0.59 () {58 vars in 1188 bytes} [Fri Aug 26 00:53:46 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:53:47.014999 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-982756aa-3409-4658-81d9-9068b39e33be tempest-VolumesTestJSON-1852121922 tempest-VolumesTestJSON-1852121922-project] Calling method '.version_select at 0x7f8a93c34430>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:53:47.171677 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-982756aa-3409-4658-81d9-9068b39e33be tempest-VolumesTestJSON-1852121922 tempest-VolumesTestJSON-1852121922-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.162241 Aug 26 00:53:47.190142 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 10/19] 10.222.0.59 () {58 vars in 1155 bytes} [Fri Aug 26 00:53:47 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:53:51.068680 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-244cdd43-2f25-48df-a2e0-b5167ac8f105 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1349162444", "imageRef": "ef60327f-6e0c-4f85-8db9-6f6e8968fe9c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:53:51.283321 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.network.neutron [None req-244cdd43-2f25-48df-a2e0-b5167ac8f105 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] validate_networks() for [('7609779d-30c3-4a34-917a-c632dbd6c083', None, None, None, None, None)] {{(pid=127564) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 00:53:51.759516 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-8bab3964-72ea-486a-999e-a1f506859466 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-747483044", "imageRef": "ef60327f-6e0c-4f85-8db9-6f6e8968fe9c", "flavorRef": "452", "networks": [{"uuid": "22430e21-d3fc-488b-bff1-ba16ab068557"}]}} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:53:51.958376 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.network.neutron [None req-8bab3964-72ea-486a-999e-a1f506859466 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] validate_networks() for [('22430e21-d3fc-488b-bff1-ba16ab068557', None, None, None, None, None)] {{(pid=127565) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 00:53:54.069231 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.virt.hardware [None req-244cdd43-2f25-48df-a2e0-b5167ac8f105 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Flavor limits 0:0:0 {{(pid=127564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 00:53:54.070263 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.virt.hardware [None req-244cdd43-2f25-48df-a2e0-b5167ac8f105 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Image limits 0:0:0 {{(pid=127564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 00:53:54.071010 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.virt.hardware [None req-244cdd43-2f25-48df-a2e0-b5167ac8f105 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Flavor pref 0:0:0 {{(pid=127564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 00:53:54.071512 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.virt.hardware [None req-244cdd43-2f25-48df-a2e0-b5167ac8f105 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Image pref 0:0:0 {{(pid=127564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 00:53:54.072163 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.virt.hardware [None req-244cdd43-2f25-48df-a2e0-b5167ac8f105 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 00:53:54.131860 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-244cdd43-2f25-48df-a2e0-b5167ac8f105 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:53:54.133231 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-244cdd43-2f25-48df-a2e0-b5167ac8f105 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:53:54.134801 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-244cdd43-2f25-48df-a2e0-b5167ac8f105 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:53:54.135739 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-244cdd43-2f25-48df-a2e0-b5167ac8f105 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:53:54.141547 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-244cdd43-2f25-48df-a2e0-b5167ac8f105 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:53:54.142146 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-244cdd43-2f25-48df-a2e0-b5167ac8f105 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:53:54.227712 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.quota [None req-244cdd43-2f25-48df-a2e0-b5167ac8f105 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Getting quotas for project 368f6a9e030e4aff9ef6559a6a165975. Resources: {'instances', 'ram', 'cores'} {{(pid=127564) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 00:53:54.285998 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.quota [None req-244cdd43-2f25-48df-a2e0-b5167ac8f105 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Getting quotas for user 0cc36def73aa4bedb9e79d4cf11f5e8c and project 368f6a9e030e4aff9ef6559a6a165975. Resources: {'instances', 'ram', 'cores'} {{(pid=127564) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 00:53:54.321826 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.virt.hardware [None req-8bab3964-72ea-486a-999e-a1f506859466 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Flavor limits 0:0:0 {{(pid=127565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 00:53:54.322951 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.virt.hardware [None req-8bab3964-72ea-486a-999e-a1f506859466 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Image limits 0:0:0 {{(pid=127565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 00:53:54.323665 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.virt.hardware [None req-8bab3964-72ea-486a-999e-a1f506859466 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Flavor pref 0:0:0 {{(pid=127565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 00:53:54.324423 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.virt.hardware [None req-8bab3964-72ea-486a-999e-a1f506859466 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Image pref 0:0:0 {{(pid=127565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 00:53:54.325187 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.virt.hardware [None req-8bab3964-72ea-486a-999e-a1f506859466 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 00:53:54.365393 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-244cdd43-2f25-48df-a2e0-b5167ac8f105 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Going to run 1 instances... {{(pid=127564) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 00:53:54.383405 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8bab3964-72ea-486a-999e-a1f506859466 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:53:54.385807 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-244cdd43-2f25-48df-a2e0-b5167ac8f105 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ef60327f-6e0c-4f85-8db9-6f6e8968fe9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 00:53:54.390706 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8bab3964-72ea-486a-999e-a1f506859466 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:53:54.396928 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8bab3964-72ea-486a-999e-a1f506859466 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:53:54.398098 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8bab3964-72ea-486a-999e-a1f506859466 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:53:54.398951 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8bab3964-72ea-486a-999e-a1f506859466 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:53:54.400438 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8bab3964-72ea-486a-999e-a1f506859466 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:53:54.512920 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.quota [None req-8bab3964-72ea-486a-999e-a1f506859466 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Getting quotas for project 032ed1b5aea842edb0bcae9d23810786. Resources: {'instances', 'ram', 'cores'} {{(pid=127565) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 00:53:54.525067 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.quota [None req-8bab3964-72ea-486a-999e-a1f506859466 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Getting quotas for user 1a425027e59242bba6b05407d19cac82 and project 032ed1b5aea842edb0bcae9d23810786. Resources: {'instances', 'ram', 'cores'} {{(pid=127565) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 00:53:54.542802 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-8bab3964-72ea-486a-999e-a1f506859466 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Going to run 1 instances... {{(pid=127565) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 00:53:54.546028 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-8bab3964-72ea-486a-999e-a1f506859466 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] [instance: d778c4bb-8dd8-4106-b7cc-12a1d485cf1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ef60327f-6e0c-4f85-8db9-6f6e8968fe9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127565) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 00:53:54.660260 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-244cdd43-2f25-48df-a2e0-b5167ac8f105 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.962023 Aug 26 00:53:54.662895 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 10/20] 10.222.0.59 () {60 vars in 1147 bytes} [Fri Aug 26 00:53:50 2022] POST /compute/v2.1/servers => generated 383 bytes in 3968 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 00:53:54.798687 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-babfb948-36f0-4fa2-81a7-0ef3cadb5158 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Action: 'create', calling method: .version_select at 0x7f8a932cf040>, body: {"keypair": {"name": "tempest-keypair-1127667667", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIg7NIh2FExc/Fy+7ZuNOEsunqoo5kWBoLzz2StI+SpAXZxgcBsW1MriQrj4eVO1CJxx5X/GZpLezs9OC+Qgczd7pOUzarOabxMvc87RpXwZvrjghtvWk/S2QKsoA5vHHQ=="}} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:53:54.842234 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-8bab3964-72ea-486a-999e-a1f506859466 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.179324 Aug 26 00:53:54.845072 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 11/21] 10.222.0.59 () {60 vars in 1147 bytes} [Fri Aug 26 00:53:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 3189 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 00:53:54.883806 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.quota [None req-babfb948-36f0-4fa2-81a7-0ef3cadb5158 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Getting quotas for project ec39c32378ac4017ad50aa6f930e514b. Resources: {'key_pairs'} {{(pid=127564) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 00:53:54.896064 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.quota [None req-babfb948-36f0-4fa2-81a7-0ef3cadb5158 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Getting quotas for user 34240c306dc54f0c8758dbb4b4525376 and project ec39c32378ac4017ad50aa6f930e514b. Resources: {'key_pairs'} {{(pid=127564) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 00:53:54.949353 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-36cd7b99-bbc6-4364-8759-ecbfb4f9a2da tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Action: 'create', calling method: .version_select at 0x7f8a932c1ee0>, body: {"keypair": {"name": "tempest-keypair-1794758417", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNt540tG291JN/pP8GuHkYwk2jjUQq+clKR/EpsgmCjVaqw25c+oY+x8MtGq4le5HJ6KtrFx6cche/hYB9qBt+qN94o6lxqjQtk9ySAVwUNPddpc2fkiFAKvXt9oc3GWSw=="}} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:53:55.017554 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.quota [None req-36cd7b99-bbc6-4364-8759-ecbfb4f9a2da tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Getting quotas for project 5219060f4c184521919b017e8435eca5. Resources: {'key_pairs'} {{(pid=127565) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 00:53:55.023603 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.quota [None req-36cd7b99-bbc6-4364-8759-ecbfb4f9a2da tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Getting quotas for user 0175a2b440704d51aa14607a2e20e36a and project 5219060f4c184521919b017e8435eca5. Resources: {'key_pairs'} {{(pid=127565) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 00:53:55.082721 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-babfb948-36f0-4fa2-81a7-0ef3cadb5158 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.416101 Aug 26 00:53:55.088250 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 11/22] 10.222.0.59 () {62 vars in 1200 bytes} [Fri Aug 26 00:53:54 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 424 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 26 00:53:55.123965 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-b4fdb83b-c9b7-426d-8093-499dc1cd51b7 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:53:55.124643 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-b4fdb83b-c9b7-426d-8093-499dc1cd51b7 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:53:55.207642 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-36cd7b99-bbc6-4364-8759-ecbfb4f9a2da tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.360592 Aug 26 00:53:55.211679 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 12/23] 10.222.0.59 () {60 vars in 1159 bytes} [Fri Aug 26 00:53:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:53:55.231365 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-79aefcff-65fc-4fa2-83d6-a13192b863f0 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:53:55.232430 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-79aefcff-65fc-4fa2-83d6-a13192b863f0 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] [instance: d778c4bb-8dd8-4106-b7cc-12a1d485cf1e] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:53:55.493607 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-b4fdb83b-c9b7-426d-8093-499dc1cd51b7 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:53:55.555864 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-b4fdb83b-c9b7-426d-8093-499dc1cd51b7 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab" status: 200 len: 1222 microversion: 2.1 time: 0.465907 Aug 26 00:53:55.556935 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 12/24] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:53:55 2022] GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab => generated 1222 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:53:55.618678 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-79aefcff-65fc-4fa2-83d6-a13192b863f0 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a425027e59242bba6b05407d19cac82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032ed1b5aea842edb0bcae9d23810786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:53:55.664562 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-79aefcff-65fc-4fa2-83d6-a13192b863f0 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] 10.222.0.59 "GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e" status: 200 len: 1214 microversion: 2.1 time: 0.443877 Aug 26 00:53:55.665330 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 13/25] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:53:55 2022] GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e => generated 1214 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:53:55.676772 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-f21f809a-ea72-452e-830d-4997efdd5c89 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1217263713", "imageRef": "ef60327f-6e0c-4f85-8db9-6f6e8968fe9c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:53:55.808685 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.network.neutron [None req-f21f809a-ea72-452e-830d-4997efdd5c89 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] validate_networks() for [('7609779d-30c3-4a34-917a-c632dbd6c083', None, None, None, None, None)] {{(pid=127564) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 00:53:56.690116 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-eec86a6a-136a-4995-814c-c0b907be0882 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:53:56.691061 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-eec86a6a-136a-4995-814c-c0b907be0882 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] [instance: d778c4bb-8dd8-4106-b7cc-12a1d485cf1e] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:53:57.063914 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-eec86a6a-136a-4995-814c-c0b907be0882 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a425027e59242bba6b05407d19cac82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032ed1b5aea842edb0bcae9d23810786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:53:57.075374 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-eec86a6a-136a-4995-814c-c0b907be0882 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] 10.222.0.59 "GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e" status: 200 len: 1214 microversion: 2.1 time: 0.389863 Aug 26 00:53:57.077806 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 14/26] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:53:56 2022] GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e => generated 1214 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:53:57.116981 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.virt.hardware [None req-f21f809a-ea72-452e-830d-4997efdd5c89 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Flavor limits 0:0:0 {{(pid=127564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 00:53:57.117522 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.virt.hardware [None req-f21f809a-ea72-452e-830d-4997efdd5c89 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Image limits 0:0:0 {{(pid=127564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 00:53:57.117973 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.virt.hardware [None req-f21f809a-ea72-452e-830d-4997efdd5c89 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Flavor pref 0:0:0 {{(pid=127564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 00:53:57.118455 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.virt.hardware [None req-f21f809a-ea72-452e-830d-4997efdd5c89 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Image pref 0:0:0 {{(pid=127564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 00:53:57.119193 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.virt.hardware [None req-f21f809a-ea72-452e-830d-4997efdd5c89 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 00:53:57.139553 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f21f809a-ea72-452e-830d-4997efdd5c89 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:53:57.140232 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f21f809a-ea72-452e-830d-4997efdd5c89 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:53:57.140911 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f21f809a-ea72-452e-830d-4997efdd5c89 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:53:57.142395 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f21f809a-ea72-452e-830d-4997efdd5c89 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:53:57.146236 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f21f809a-ea72-452e-830d-4997efdd5c89 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:53:57.146917 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f21f809a-ea72-452e-830d-4997efdd5c89 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:53:57.220960 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.quota [None req-f21f809a-ea72-452e-830d-4997efdd5c89 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Getting quotas for project 368f6a9e030e4aff9ef6559a6a165975. Resources: {'instances', 'ram', 'cores'} {{(pid=127564) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 00:53:57.228022 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.quota [None req-f21f809a-ea72-452e-830d-4997efdd5c89 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Getting quotas for user 0cc36def73aa4bedb9e79d4cf11f5e8c and project 368f6a9e030e4aff9ef6559a6a165975. Resources: {'instances', 'ram', 'cores'} {{(pid=127564) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 00:53:57.245134 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-f21f809a-ea72-452e-830d-4997efdd5c89 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Going to run 1 instances... {{(pid=127564) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 00:53:57.248218 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-f21f809a-ea72-452e-830d-4997efdd5c89 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ef60327f-6e0c-4f85-8db9-6f6e8968fe9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 00:53:57.449708 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-f21f809a-ea72-452e-830d-4997efdd5c89 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.778733 Aug 26 00:53:57.457501 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 13/27] 10.222.0.59 () {60 vars in 1147 bytes} [Fri Aug 26 00:53:55 2022] POST /compute/v2.1/servers => generated 383 bytes in 1789 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 00:53:57.462426 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-6ee9e5af-244e-40fe-9e19-a5984c10ff95 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:53:57.463084 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-6ee9e5af-244e-40fe-9e19-a5984c10ff95 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:53:57.688632 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-6ee9e5af-244e-40fe-9e19-a5984c10ff95 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:53:57.697918 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-6ee9e5af-244e-40fe-9e19-a5984c10ff95 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1222 microversion: 2.1 time: 0.240045 Aug 26 00:53:57.699883 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 15/28] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:53:57 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1222 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:53:58.100615 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-c72b4b6a-8022-4014-8853-0fe91626fdf3 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:53:58.101614 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-c72b4b6a-8022-4014-8853-0fe91626fdf3 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] [instance: d778c4bb-8dd8-4106-b7cc-12a1d485cf1e] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:53:58.113783 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c72b4b6a-8022-4014-8853-0fe91626fdf3 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:53:58.122401 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c72b4b6a-8022-4014-8853-0fe91626fdf3 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:53:58.123635 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c72b4b6a-8022-4014-8853-0fe91626fdf3 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:53:58.124548 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c72b4b6a-8022-4014-8853-0fe91626fdf3 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:53:58.125128 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c72b4b6a-8022-4014-8853-0fe91626fdf3 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:53:58.129934 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c72b4b6a-8022-4014-8853-0fe91626fdf3 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:53:58.560093 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-c72b4b6a-8022-4014-8853-0fe91626fdf3 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a425027e59242bba6b05407d19cac82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032ed1b5aea842edb0bcae9d23810786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:53:58.582046 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-c72b4b6a-8022-4014-8853-0fe91626fdf3 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] 10.222.0.59 "GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e" status: 200 len: 1218 microversion: 2.1 time: 0.485125 Aug 26 00:53:58.622766 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 14/29] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:53:58 2022] GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e => generated 1218 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:53:58.720353 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-fec36cab-6b48-4d53-9a02-709ac96859a6 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:53:58.722273 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-fec36cab-6b48-4d53-9a02-709ac96859a6 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:53:59.141919 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-fec36cab-6b48-4d53-9a02-709ac96859a6 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:53:59.155001 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-fec36cab-6b48-4d53-9a02-709ac96859a6 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1222 microversion: 2.1 time: 0.439137 Aug 26 00:53:59.156146 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 16/30] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:53:58 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1222 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:53:59.607066 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-cbbd9379-575d-4afd-844e-3f193f7fe607 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:53:59.608451 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-cbbd9379-575d-4afd-844e-3f193f7fe607 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] [instance: d778c4bb-8dd8-4106-b7cc-12a1d485cf1e] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:53:59.619362 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-cbbd9379-575d-4afd-844e-3f193f7fe607 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:53:59.620007 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-cbbd9379-575d-4afd-844e-3f193f7fe607 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:53:59.622523 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-cbbd9379-575d-4afd-844e-3f193f7fe607 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:53:59.623688 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-cbbd9379-575d-4afd-844e-3f193f7fe607 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:53:59.625050 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-cbbd9379-575d-4afd-844e-3f193f7fe607 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:53:59.625787 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-cbbd9379-575d-4afd-844e-3f193f7fe607 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:53:59.755151 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-cbbd9379-575d-4afd-844e-3f193f7fe607 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a425027e59242bba6b05407d19cac82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032ed1b5aea842edb0bcae9d23810786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:53:59.765482 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-cbbd9379-575d-4afd-844e-3f193f7fe607 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] 10.222.0.59 "GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e" status: 200 len: 1266 microversion: 2.1 time: 0.163261 Aug 26 00:53:59.784657 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 15/31] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:53:59 2022] GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:00.175175 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-0ff6ad71-aaa2-4f1e-a581-83e7d967086a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:00.175779 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-0ff6ad71-aaa2-4f1e-a581-83e7d967086a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:00.212968 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0ff6ad71-aaa2-4f1e-a581-83e7d967086a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:00.214376 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0ff6ad71-aaa2-4f1e-a581-83e7d967086a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:00.216229 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0ff6ad71-aaa2-4f1e-a581-83e7d967086a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:00.221545 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0ff6ad71-aaa2-4f1e-a581-83e7d967086a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:00.225392 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0ff6ad71-aaa2-4f1e-a581-83e7d967086a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:00.232158 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0ff6ad71-aaa2-4f1e-a581-83e7d967086a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:00.665496 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-0ff6ad71-aaa2-4f1e-a581-83e7d967086a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:00.684134 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-0ff6ad71-aaa2-4f1e-a581-83e7d967086a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1274 microversion: 2.1 time: 0.512724 Aug 26 00:54:00.684742 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 17/32] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:00 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1274 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:00.794978 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-a63fbe72-786c-4bed-91d1-1ad109030864 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:00.794978 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-a63fbe72-786c-4bed-91d1-1ad109030864 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] [instance: d778c4bb-8dd8-4106-b7cc-12a1d485cf1e] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:00.797876 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a63fbe72-786c-4bed-91d1-1ad109030864 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:00.798540 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a63fbe72-786c-4bed-91d1-1ad109030864 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:00.799151 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a63fbe72-786c-4bed-91d1-1ad109030864 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:00.800003 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a63fbe72-786c-4bed-91d1-1ad109030864 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:00.800666 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a63fbe72-786c-4bed-91d1-1ad109030864 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:00.801276 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a63fbe72-786c-4bed-91d1-1ad109030864 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:01.074507 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-a63fbe72-786c-4bed-91d1-1ad109030864 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a425027e59242bba6b05407d19cac82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032ed1b5aea842edb0bcae9d23810786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:01.086070 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-a63fbe72-786c-4bed-91d1-1ad109030864 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] 10.222.0.59 "GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e" status: 200 len: 1284 microversion: 2.1 time: 0.301146 Aug 26 00:54:01.093365 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 16/33] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:00 2022] GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e => generated 1284 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:01.709222 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-d00b5d78-778e-4e3d-9804-3c4afa023847 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:01.709836 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-d00b5d78-778e-4e3d-9804-3c4afa023847 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:01.722171 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d00b5d78-778e-4e3d-9804-3c4afa023847 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:01.722677 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d00b5d78-778e-4e3d-9804-3c4afa023847 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:01.734622 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d00b5d78-778e-4e3d-9804-3c4afa023847 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:01.734622 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d00b5d78-778e-4e3d-9804-3c4afa023847 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:01.734622 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d00b5d78-778e-4e3d-9804-3c4afa023847 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:01.734622 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d00b5d78-778e-4e3d-9804-3c4afa023847 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:01.863866 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-2109b758-58ff-44a6-9977-ad542d0922f7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-34863737", "imageRef": "ef60327f-6e0c-4f85-8db9-6f6e8968fe9c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "82719f0d-e147-413c-83ac-404aae47d6de"}], "security_groups": [{"name": "tempest-securitygroup--1967920129"}], "key_name": "tempest-keypair-1127667667", "user_data": "}} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:54:02.129226 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-d00b5d78-778e-4e3d-9804-3c4afa023847 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:02.137805 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-d00b5d78-778e-4e3d-9804-3c4afa023847 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1292 microversion: 2.1 time: 0.432794 Aug 26 00:54:02.138390 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 18/34] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:01 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1292 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:02.164066 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-80acdbe6-88aa-4c65-8838-452103636cee tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:02.171039 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-80acdbe6-88aa-4c65-8838-452103636cee tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] [instance: d778c4bb-8dd8-4106-b7cc-12a1d485cf1e] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:02.188023 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-80acdbe6-88aa-4c65-8838-452103636cee tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:02.190689 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-80acdbe6-88aa-4c65-8838-452103636cee tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:02.191196 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-80acdbe6-88aa-4c65-8838-452103636cee tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:02.195855 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-80acdbe6-88aa-4c65-8838-452103636cee tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:02.195855 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-80acdbe6-88aa-4c65-8838-452103636cee tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:02.202530 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-80acdbe6-88aa-4c65-8838-452103636cee tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:02.334360 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.network.neutron [None req-2109b758-58ff-44a6-9977-ad542d0922f7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] validate_networks() for [('82719f0d-e147-413c-83ac-404aae47d6de', None, None, None, None, None)] {{(pid=127564) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 00:54:02.372362 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-80acdbe6-88aa-4c65-8838-452103636cee tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a425027e59242bba6b05407d19cac82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032ed1b5aea842edb0bcae9d23810786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:02.381439 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-80acdbe6-88aa-4c65-8838-452103636cee tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] 10.222.0.59 "GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e" status: 200 len: 1272 microversion: 2.1 time: 0.241981 Aug 26 00:54:02.385225 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 19/35] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:02 2022] GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e => generated 1272 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:03.029475 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-b60086e7-19f8-441e-8ed0-744b5398abbf tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-687048178", "imageRef": "ef60327f-6e0c-4f85-8db9-6f6e8968fe9c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a7f4c88d-45f2-48d0-b1db-d03d08216bf5"}], "security_groups": [{"name": "tempest-securitygroup--794511153"}], "key_name": "tempest-keypair-1794758417", "user_data": "}} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:54:03.373796 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.network.neutron [None req-b60086e7-19f8-441e-8ed0-744b5398abbf tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] validate_networks() for [('a7f4c88d-45f2-48d0-b1db-d03d08216bf5', None, None, None, None, None)] {{(pid=127565) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 00:54:03.869424 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.virt.hardware [None req-2109b758-58ff-44a6-9977-ad542d0922f7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Flavor limits 0:0:0 {{(pid=127564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 00:54:03.869906 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.virt.hardware [None req-2109b758-58ff-44a6-9977-ad542d0922f7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Image limits 0:0:0 {{(pid=127564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 00:54:03.870677 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.virt.hardware [None req-2109b758-58ff-44a6-9977-ad542d0922f7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Flavor pref 0:0:0 {{(pid=127564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 00:54:03.870959 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.virt.hardware [None req-2109b758-58ff-44a6-9977-ad542d0922f7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Image pref 0:0:0 {{(pid=127564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 00:54:03.871374 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.virt.hardware [None req-2109b758-58ff-44a6-9977-ad542d0922f7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 00:54:03.889471 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2109b758-58ff-44a6-9977-ad542d0922f7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:03.890082 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2109b758-58ff-44a6-9977-ad542d0922f7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:03.890550 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2109b758-58ff-44a6-9977-ad542d0922f7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:03.921907 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2109b758-58ff-44a6-9977-ad542d0922f7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:03.921907 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2109b758-58ff-44a6-9977-ad542d0922f7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:03.921907 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2109b758-58ff-44a6-9977-ad542d0922f7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:03.997606 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.quota [None req-2109b758-58ff-44a6-9977-ad542d0922f7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Getting quotas for project ec39c32378ac4017ad50aa6f930e514b. Resources: {'instances', 'ram', 'cores'} {{(pid=127564) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 00:54:04.011245 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.quota [None req-2109b758-58ff-44a6-9977-ad542d0922f7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Getting quotas for user 34240c306dc54f0c8758dbb4b4525376 and project ec39c32378ac4017ad50aa6f930e514b. Resources: {'instances', 'ram', 'cores'} {{(pid=127564) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 00:54:04.084414 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-2109b758-58ff-44a6-9977-ad542d0922f7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Going to run 1 instances... {{(pid=127564) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 00:54:04.087505 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-2109b758-58ff-44a6-9977-ad542d0922f7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ef60327f-6e0c-4f85-8db9-6f6e8968fe9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 00:54:04.280546 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-2109b758-58ff-44a6-9977-ad542d0922f7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.435241 Aug 26 00:54:04.283189 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 17/36] 10.222.0.59 () {62 vars in 1188 bytes} [Fri Aug 26 00:54:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 2438 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 26 00:54:04.300833 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-d14bf9dc-3dd5-4f66-afa8-56f758a726bd tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:04.305455 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-d14bf9dc-3dd5-4f66-afa8-56f758a726bd tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:04.348877 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-d14bf9dc-3dd5-4f66-afa8-56f758a726bd tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:04.348877 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-d14bf9dc-3dd5-4f66-afa8-56f758a726bd tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:04.348877 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-d14bf9dc-3dd5-4f66-afa8-56f758a726bd tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:04.348877 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-d14bf9dc-3dd5-4f66-afa8-56f758a726bd tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:04.350020 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-d14bf9dc-3dd5-4f66-afa8-56f758a726bd tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:04.350020 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-d14bf9dc-3dd5-4f66-afa8-56f758a726bd tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:04.666827 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell0:SELECT=2 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:54:04.822765 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-d14bf9dc-3dd5-4f66-afa8-56f758a726bd tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:04.846633 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-d14bf9dc-3dd5-4f66-afa8-56f758a726bd tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1280 microversion: 2.1 time: 0.561958 Aug 26 00:54:04.855247 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 18/37] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:04 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1280 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:04.871112 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-7c88941a-92df-4712-9ef2-00e4e14d17de tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:04.871828 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-7c88941a-92df-4712-9ef2-00e4e14d17de tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] [instance: d778c4bb-8dd8-4106-b7cc-12a1d485cf1e] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:04.910041 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-7c88941a-92df-4712-9ef2-00e4e14d17de tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:04.912816 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-7c88941a-92df-4712-9ef2-00e4e14d17de tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:04.913452 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-7c88941a-92df-4712-9ef2-00e4e14d17de tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:04.922194 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-7c88941a-92df-4712-9ef2-00e4e14d17de tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:04.922704 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-7c88941a-92df-4712-9ef2-00e4e14d17de tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:04.923217 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-7c88941a-92df-4712-9ef2-00e4e14d17de tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:05.549877 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-7c88941a-92df-4712-9ef2-00e4e14d17de tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a425027e59242bba6b05407d19cac82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032ed1b5aea842edb0bcae9d23810786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:05.564369 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-7c88941a-92df-4712-9ef2-00e4e14d17de tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] 10.222.0.59 "GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e" status: 200 len: 1314 microversion: 2.1 time: 0.707260 Aug 26 00:54:05.574044 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 19/38] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:04 2022] GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e => generated 1314 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:05.598510 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-5e47fbac-24c5-4a6f-91bb-d20638c3e67b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:05.598510 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-5e47fbac-24c5-4a6f-91bb-d20638c3e67b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:05.757065 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-5e47fbac-24c5-4a6f-91bb-d20638c3e67b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:05.772641 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-5e47fbac-24c5-4a6f-91bb-d20638c3e67b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:05.775139 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-5e47fbac-24c5-4a6f-91bb-d20638c3e67b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:05.785322 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-5e47fbac-24c5-4a6f-91bb-d20638c3e67b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1280 microversion: 2.20 time: 0.194093 Aug 26 00:54:05.786702 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 20/39] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:54:05 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1280 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:54:05.876393 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-7646dfe1-50e6-4a7f-9871-449755197856 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:05.885862 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-7646dfe1-50e6-4a7f-9871-449755197856 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:05.903982 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-7646dfe1-50e6-4a7f-9871-449755197856 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:05.904515 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-7646dfe1-50e6-4a7f-9871-449755197856 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:05.904948 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-7646dfe1-50e6-4a7f-9871-449755197856 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:05.905660 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-7646dfe1-50e6-4a7f-9871-449755197856 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:05.906111 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-7646dfe1-50e6-4a7f-9871-449755197856 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:05.906536 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-7646dfe1-50e6-4a7f-9871-449755197856 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:05.967836 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.virt.hardware [None req-b60086e7-19f8-441e-8ed0-744b5398abbf tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Flavor limits 0:0:0 {{(pid=127565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 00:54:05.968834 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.virt.hardware [None req-b60086e7-19f8-441e-8ed0-744b5398abbf tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Image limits 0:0:0 {{(pid=127565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 00:54:05.973487 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.virt.hardware [None req-b60086e7-19f8-441e-8ed0-744b5398abbf tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Flavor pref 0:0:0 {{(pid=127565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 00:54:05.973487 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.virt.hardware [None req-b60086e7-19f8-441e-8ed0-744b5398abbf tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Image pref 0:0:0 {{(pid=127565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 00:54:05.973487 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.virt.hardware [None req-b60086e7-19f8-441e-8ed0-744b5398abbf tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 00:54:06.004229 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b60086e7-19f8-441e-8ed0-744b5398abbf tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:06.005562 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b60086e7-19f8-441e-8ed0-744b5398abbf tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:06.007876 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b60086e7-19f8-441e-8ed0-744b5398abbf tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:06.012947 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b60086e7-19f8-441e-8ed0-744b5398abbf tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:06.013756 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b60086e7-19f8-441e-8ed0-744b5398abbf tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:06.014617 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b60086e7-19f8-441e-8ed0-744b5398abbf tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:06.061837 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.quota [None req-b60086e7-19f8-441e-8ed0-744b5398abbf tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Getting quotas for project 5219060f4c184521919b017e8435eca5. Resources: {'instances', 'ram', 'cores'} {{(pid=127565) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 00:54:06.073321 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.quota [None req-b60086e7-19f8-441e-8ed0-744b5398abbf tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Getting quotas for user 0175a2b440704d51aa14607a2e20e36a and project 5219060f4c184521919b017e8435eca5. Resources: {'instances', 'ram', 'cores'} {{(pid=127565) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 00:54:06.122781 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-b60086e7-19f8-441e-8ed0-744b5398abbf tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Going to run 1 instances... {{(pid=127565) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 00:54:06.126775 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-b60086e7-19f8-441e-8ed0-744b5398abbf tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ef60327f-6e0c-4f85-8db9-6f6e8968fe9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127565) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 00:54:06.228071 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-7646dfe1-50e6-4a7f-9871-449755197856 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:06.242480 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-7646dfe1-50e6-4a7f-9871-449755197856 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1322 microversion: 2.1 time: 0.370475 Aug 26 00:54:06.247220 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 21/40] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:05 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1322 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:06.336260 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-b60086e7-19f8-441e-8ed0-744b5398abbf tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.329203 Aug 26 00:54:06.338537 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 20/41] 10.222.0.59 () {60 vars in 1147 bytes} [Fri Aug 26 00:54:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 3332 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 00:54:06.355931 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-b227d0c6-2d55-4288-afcd-68f0c6284bb3 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:06.356689 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-b227d0c6-2d55-4288-afcd-68f0c6284bb3 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:06.598321 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-d7f9bbdf-2516-4ad7-89f2-f32c9dce64a9 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:06.600955 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-d7f9bbdf-2516-4ad7-89f2-f32c9dce64a9 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] [instance: d778c4bb-8dd8-4106-b7cc-12a1d485cf1e] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:06.611977 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d7f9bbdf-2516-4ad7-89f2-f32c9dce64a9 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:06.620107 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d7f9bbdf-2516-4ad7-89f2-f32c9dce64a9 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:06.621400 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d7f9bbdf-2516-4ad7-89f2-f32c9dce64a9 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:06.629685 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d7f9bbdf-2516-4ad7-89f2-f32c9dce64a9 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:06.629685 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d7f9bbdf-2516-4ad7-89f2-f32c9dce64a9 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:06.629685 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d7f9bbdf-2516-4ad7-89f2-f32c9dce64a9 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:07.125481 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-b227d0c6-2d55-4288-afcd-68f0c6284bb3 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:07.144432 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-b227d0c6-2d55-4288-afcd-68f0c6284bb3 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1237 microversion: 2.1 time: 0.791351 Aug 26 00:54:07.159507 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 22/42] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:06 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1237 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:07.168206 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-59de40ce-9bfc-4768-bf89-6af28158a1b6 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:07.171663 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-59de40ce-9bfc-4768-bf89-6af28158a1b6 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:07.186223 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-59de40ce-9bfc-4768-bf89-6af28158a1b6 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:07.190141 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-59de40ce-9bfc-4768-bf89-6af28158a1b6 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:07.192071 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-59de40ce-9bfc-4768-bf89-6af28158a1b6 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:07.193470 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-59de40ce-9bfc-4768-bf89-6af28158a1b6 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:07.194338 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-59de40ce-9bfc-4768-bf89-6af28158a1b6 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:07.195208 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-59de40ce-9bfc-4768-bf89-6af28158a1b6 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:07.236293 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-d7f9bbdf-2516-4ad7-89f2-f32c9dce64a9 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a425027e59242bba6b05407d19cac82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032ed1b5aea842edb0bcae9d23810786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:07.273335 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-d7f9bbdf-2516-4ad7-89f2-f32c9dce64a9 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] 10.222.0.59 "GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e" status: 200 len: 1314 microversion: 2.1 time: 0.679191 Aug 26 00:54:07.278952 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 21/43] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:06 2022] GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e => generated 1314 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:07.293326 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-d4ee5e28-040c-4a9e-a566-30d0a45fbe44 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:07.296988 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-d4ee5e28-040c-4a9e-a566-30d0a45fbe44 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:07.305813 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d4ee5e28-040c-4a9e-a566-30d0a45fbe44 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:07.307397 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d4ee5e28-040c-4a9e-a566-30d0a45fbe44 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:07.308345 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d4ee5e28-040c-4a9e-a566-30d0a45fbe44 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:07.309543 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d4ee5e28-040c-4a9e-a566-30d0a45fbe44 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:07.310568 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d4ee5e28-040c-4a9e-a566-30d0a45fbe44 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:07.311309 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d4ee5e28-040c-4a9e-a566-30d0a45fbe44 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:07.524249 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-59de40ce-9bfc-4768-bf89-6af28158a1b6 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:07.535135 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-59de40ce-9bfc-4768-bf89-6af28158a1b6 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:07.538093 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-59de40ce-9bfc-4768-bf89-6af28158a1b6 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:07.545355 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-59de40ce-9bfc-4768-bf89-6af28158a1b6 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1276 microversion: 2.20 time: 0.384801 Aug 26 00:54:07.545355 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 23/44] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:54:07 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1276 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:54:08.042637 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-d4ee5e28-040c-4a9e-a566-30d0a45fbe44 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:08.057643 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-d4ee5e28-040c-4a9e-a566-30d0a45fbe44 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1322 microversion: 2.1 time: 0.777219 Aug 26 00:54:08.058678 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 22/45] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:07 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1322 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:08.181016 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-859a7df4-fe66-4f1e-b72b-0ae5fdd2ff1f tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:08.181617 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-859a7df4-fe66-4f1e-b72b-0ae5fdd2ff1f tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:08.190880 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-859a7df4-fe66-4f1e-b72b-0ae5fdd2ff1f tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:08.190880 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-859a7df4-fe66-4f1e-b72b-0ae5fdd2ff1f tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:08.191182 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-859a7df4-fe66-4f1e-b72b-0ae5fdd2ff1f tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:08.197621 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-859a7df4-fe66-4f1e-b72b-0ae5fdd2ff1f tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:08.198101 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-859a7df4-fe66-4f1e-b72b-0ae5fdd2ff1f tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:08.198568 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-859a7df4-fe66-4f1e-b72b-0ae5fdd2ff1f tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:08.299072 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-a21c3a77-7e74-4abd-8850-d64958dc7b4b tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:08.299688 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-a21c3a77-7e74-4abd-8850-d64958dc7b4b tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] [instance: d778c4bb-8dd8-4106-b7cc-12a1d485cf1e] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:08.323892 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a21c3a77-7e74-4abd-8850-d64958dc7b4b tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:08.323892 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a21c3a77-7e74-4abd-8850-d64958dc7b4b tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:08.323892 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a21c3a77-7e74-4abd-8850-d64958dc7b4b tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:08.323892 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a21c3a77-7e74-4abd-8850-d64958dc7b4b tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:08.324151 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a21c3a77-7e74-4abd-8850-d64958dc7b4b tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:08.324151 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a21c3a77-7e74-4abd-8850-d64958dc7b4b tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:08.944283 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-859a7df4-fe66-4f1e-b72b-0ae5fdd2ff1f tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:08.960152 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-859a7df4-fe66-4f1e-b72b-0ae5fdd2ff1f tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1241 microversion: 2.1 time: 0.796276 Aug 26 00:54:08.968447 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 24/46] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:08 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1241 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:08.977527 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-882b08cd-85fb-494e-b1ee-70f3b1211a7f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:08.987185 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-882b08cd-85fb-494e-b1ee-70f3b1211a7f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:09.001811 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-882b08cd-85fb-494e-b1ee-70f3b1211a7f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:09.001811 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-882b08cd-85fb-494e-b1ee-70f3b1211a7f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:09.001811 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-882b08cd-85fb-494e-b1ee-70f3b1211a7f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:09.008861 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-a21c3a77-7e74-4abd-8850-d64958dc7b4b tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a425027e59242bba6b05407d19cac82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032ed1b5aea842edb0bcae9d23810786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:09.017011 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-a21c3a77-7e74-4abd-8850-d64958dc7b4b tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] 10.222.0.59 "GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e" status: 200 len: 1314 microversion: 2.1 time: 0.721579 Aug 26 00:54:09.017327 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-882b08cd-85fb-494e-b1ee-70f3b1211a7f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:09.018158 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-882b08cd-85fb-494e-b1ee-70f3b1211a7f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:09.021259 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-882b08cd-85fb-494e-b1ee-70f3b1211a7f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:09.025399 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 23/47] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:08 2022] GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e => generated 1314 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:54:09.079268 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-23d3bf6f-fede-4484-824c-c8d1c9bad395 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:09.080263 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-23d3bf6f-fede-4484-824c-c8d1c9bad395 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:09.088367 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-23d3bf6f-fede-4484-824c-c8d1c9bad395 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:09.112045 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-23d3bf6f-fede-4484-824c-c8d1c9bad395 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:09.113407 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-23d3bf6f-fede-4484-824c-c8d1c9bad395 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:09.119597 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-23d3bf6f-fede-4484-824c-c8d1c9bad395 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:09.130876 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-23d3bf6f-fede-4484-824c-c8d1c9bad395 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:09.133076 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-23d3bf6f-fede-4484-824c-c8d1c9bad395 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:09.339491 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-882b08cd-85fb-494e-b1ee-70f3b1211a7f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:09.343344 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-882b08cd-85fb-494e-b1ee-70f3b1211a7f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:09.353027 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-882b08cd-85fb-494e-b1ee-70f3b1211a7f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:09.354924 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-882b08cd-85fb-494e-b1ee-70f3b1211a7f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1340 microversion: 2.20 time: 0.383492 Aug 26 00:54:09.371105 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 25/48] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:54:08 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1340 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:54:09.986404 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-3cebea3a-bcaf-4c83-a531-00809266daca tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:09.987439 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-3cebea3a-bcaf-4c83-a531-00809266daca tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:09.998744 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3cebea3a-bcaf-4c83-a531-00809266daca tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:09.999248 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3cebea3a-bcaf-4c83-a531-00809266daca tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:09.999732 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3cebea3a-bcaf-4c83-a531-00809266daca tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:10.000504 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3cebea3a-bcaf-4c83-a531-00809266daca tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:10.000974 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3cebea3a-bcaf-4c83-a531-00809266daca tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:10.001405 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3cebea3a-bcaf-4c83-a531-00809266daca tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:10.351299 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-23d3bf6f-fede-4484-824c-c8d1c9bad395 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:10.362595 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-23d3bf6f-fede-4484-824c-c8d1c9bad395 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1322 microversion: 2.1 time: 1.286721 Aug 26 00:54:10.367351 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 24/49] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:09 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1322 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:54:10.397957 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-e0ff1741-e75e-4ee7-85ab-baa678fc27dc tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:10.398818 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-e0ff1741-e75e-4ee7-85ab-baa678fc27dc tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] [instance: d778c4bb-8dd8-4106-b7cc-12a1d485cf1e] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:10.421310 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e0ff1741-e75e-4ee7-85ab-baa678fc27dc tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:10.421810 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e0ff1741-e75e-4ee7-85ab-baa678fc27dc tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:10.422266 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e0ff1741-e75e-4ee7-85ab-baa678fc27dc tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:10.423306 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e0ff1741-e75e-4ee7-85ab-baa678fc27dc tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:10.423462 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e0ff1741-e75e-4ee7-85ab-baa678fc27dc tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:10.425818 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e0ff1741-e75e-4ee7-85ab-baa678fc27dc tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:10.464126 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-3cebea3a-bcaf-4c83-a531-00809266daca tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:10.479077 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-3cebea3a-bcaf-4c83-a531-00809266daca tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1289 microversion: 2.1 time: 0.497206 Aug 26 00:54:10.479661 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 26/50] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:09 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1289 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:10.627480 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [req-88ca9bd8-e61b-4e5d-aeb8-dab6a7ab377a req-f9bf19a3-960b-4465-9830-9684c1d0779c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be", "tag": "833db4f2-eca1-40db-a1e7-c07312b7e9d1"}]} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:54:10.665041 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-88ca9bd8-e61b-4e5d-aeb8-dab6a7ab377a req-f9bf19a3-960b-4465-9830-9684c1d0779c service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:10.666740 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-88ca9bd8-e61b-4e5d-aeb8-dab6a7ab377a req-f9bf19a3-960b-4465-9830-9684c1d0779c service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:10.668566 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-88ca9bd8-e61b-4e5d-aeb8-dab6a7ab377a req-f9bf19a3-960b-4465-9830-9684c1d0779c service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:10.713363 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.compute.server_external_events [req-88ca9bd8-e61b-4e5d-aeb8-dab6a7ab377a req-f9bf19a3-960b-4465-9830-9684c1d0779c service nova] Creating event network-changed:833db4f2-eca1-40db-a1e7-c07312b7e9d1 for instance 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be on hv-cinder-83538 Aug 26 00:54:10.713481 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-e0ff1741-e75e-4ee7-85ab-baa678fc27dc tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a425027e59242bba6b05407d19cac82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032ed1b5aea842edb0bcae9d23810786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:10.713906 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-88ca9bd8-e61b-4e5d-aeb8-dab6a7ab377a req-f9bf19a3-960b-4465-9830-9684c1d0779c service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127564) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 26 00:54:10.714309 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-88ca9bd8-e61b-4e5d-aeb8-dab6a7ab377a req-f9bf19a3-960b-4465-9830-9684c1d0779c service nova] Acquired lock "compute-rpcapi-router" {{(pid=127564) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 26 00:54:10.718097 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9aa1185f-d789-4330-8aad-f742fbb7f908 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:10.718572 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9aa1185f-d789-4330-8aad-f742fbb7f908 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:10.722788 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-e0ff1741-e75e-4ee7-85ab-baa678fc27dc tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] 10.222.0.59 "GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e" status: 200 len: 1314 microversion: 2.1 time: 0.343826 Aug 26 00:54:10.724881 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9aa1185f-d789-4330-8aad-f742fbb7f908 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:10.726043 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9aa1185f-d789-4330-8aad-f742fbb7f908 None None] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:10.726677 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9aa1185f-d789-4330-8aad-f742fbb7f908 None None] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:10.726954 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9aa1185f-d789-4330-8aad-f742fbb7f908 None None] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:10.730667 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 25/51] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:10 2022] GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e => generated 1314 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:10.748334 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.compute.rpcapi [None req-9aa1185f-d789-4330-8aad-f742fbb7f908 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 26 00:54:10.749543 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9aa1185f-d789-4330-8aad-f742fbb7f908 None None] Releasing lock "compute-rpcapi-router" {{(pid=127564) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 26 00:54:10.756345 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-ad9d93f6-3132-4df4-80f9-2c9406981db5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:10.757451 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-ad9d93f6-3132-4df4-80f9-2c9406981db5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:10.790282 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ad9d93f6-3132-4df4-80f9-2c9406981db5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:10.796960 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ad9d93f6-3132-4df4-80f9-2c9406981db5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:10.797764 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ad9d93f6-3132-4df4-80f9-2c9406981db5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:10.801110 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ad9d93f6-3132-4df4-80f9-2c9406981db5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:10.801675 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ad9d93f6-3132-4df4-80f9-2c9406981db5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:10.802122 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ad9d93f6-3132-4df4-80f9-2c9406981db5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:10.803881 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-9aa1185f-d789-4330-8aad-f742fbb7f908 None None] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.319666 Aug 26 00:54:10.804939 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 27/52] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 00:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:54:11.390196 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-a005447c-f1fa-48ab-8958-4ec3473b7350 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:11.391445 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-a005447c-f1fa-48ab-8958-4ec3473b7350 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:11.403746 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a005447c-f1fa-48ab-8958-4ec3473b7350 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:11.405173 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a005447c-f1fa-48ab-8958-4ec3473b7350 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:11.405825 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a005447c-f1fa-48ab-8958-4ec3473b7350 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:11.409515 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a005447c-f1fa-48ab-8958-4ec3473b7350 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:11.410264 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a005447c-f1fa-48ab-8958-4ec3473b7350 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:11.412201 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a005447c-f1fa-48ab-8958-4ec3473b7350 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:11.495798 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-ad9d93f6-3132-4df4-80f9-2c9406981db5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:11.509829 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-ad9d93f6-3132-4df4-80f9-2c9406981db5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:11.515331 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-ad9d93f6-3132-4df4-80f9-2c9406981db5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:11.523364 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-ad9d93f6-3132-4df4-80f9-2c9406981db5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1338 microversion: 2.20 time: 0.790153 Aug 26 00:54:11.524228 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 26/53] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:54:10 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1338 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:54:11.548638 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-5ecc11bd-2eed-4344-8097-6950f8988751 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:11.550445 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-5ecc11bd-2eed-4344-8097-6950f8988751 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:11.566619 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5ecc11bd-2eed-4344-8097-6950f8988751 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:11.569008 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5ecc11bd-2eed-4344-8097-6950f8988751 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:11.569735 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5ecc11bd-2eed-4344-8097-6950f8988751 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:11.570628 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5ecc11bd-2eed-4344-8097-6950f8988751 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:11.572779 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5ecc11bd-2eed-4344-8097-6950f8988751 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:11.573499 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5ecc11bd-2eed-4344-8097-6950f8988751 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:11.812910 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-5ecc11bd-2eed-4344-8097-6950f8988751 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:11.832439 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-5ecc11bd-2eed-4344-8097-6950f8988751 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1307 microversion: 2.1 time: 0.290227 Aug 26 00:54:11.838851 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 27/54] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:11 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1307 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:12.451181 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [req-ab067250-c1f3-4436-b41b-bfc3dca44919 req-2d50b454-8fac-4b80-ac77-198a9a78d64b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3079fdb4-9b6d-4030-a7ce-bdf5bff324ab", "tag": "370c2a59-a26b-4a3e-8768-1300357aad68"}]} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:54:12.466379 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-ab067250-c1f3-4436-b41b-bfc3dca44919 req-2d50b454-8fac-4b80-ac77-198a9a78d64b service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:12.475355 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-ab067250-c1f3-4436-b41b-bfc3dca44919 req-2d50b454-8fac-4b80-ac77-198a9a78d64b service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:12.476220 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-ab067250-c1f3-4436-b41b-bfc3dca44919 req-2d50b454-8fac-4b80-ac77-198a9a78d64b service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:12.517216 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.compute.server_external_events [req-ab067250-c1f3-4436-b41b-bfc3dca44919 req-2d50b454-8fac-4b80-ac77-198a9a78d64b service nova] Creating event network-changed:370c2a59-a26b-4a3e-8768-1300357aad68 for instance 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab on hv-cinder-83538 Aug 26 00:54:12.518000 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-ab067250-c1f3-4436-b41b-bfc3dca44919 req-2d50b454-8fac-4b80-ac77-198a9a78d64b service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127565) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 26 00:54:12.518155 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-ab067250-c1f3-4436-b41b-bfc3dca44919 req-2d50b454-8fac-4b80-ac77-198a9a78d64b service nova] Acquired lock "compute-rpcapi-router" {{(pid=127565) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 26 00:54:12.519191 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ea9d3f8d-d095-449e-9ad6-e932ac145981 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:12.519644 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ea9d3f8d-d095-449e-9ad6-e932ac145981 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:12.520067 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ea9d3f8d-d095-449e-9ad6-e932ac145981 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:12.521049 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ea9d3f8d-d095-449e-9ad6-e932ac145981 None None] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:12.521864 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ea9d3f8d-d095-449e-9ad6-e932ac145981 None None] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:12.522503 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ea9d3f8d-d095-449e-9ad6-e932ac145981 None None] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:12.531743 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.compute.rpcapi [None req-ea9d3f8d-d095-449e-9ad6-e932ac145981 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 26 00:54:12.532698 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ea9d3f8d-d095-449e-9ad6-e932ac145981 None None] Releasing lock "compute-rpcapi-router" {{(pid=127565) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 26 00:54:12.566457 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-ea9d3f8d-d095-449e-9ad6-e932ac145981 None None] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.721074 Aug 26 00:54:12.568530 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 28/55] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 00:54:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:54:12.593204 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-8a458f58-6d20-4081-8f88-8678f6f9280c tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:12.593888 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-8a458f58-6d20-4081-8f88-8678f6f9280c tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] [instance: d778c4bb-8dd8-4106-b7cc-12a1d485cf1e] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:12.601901 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8a458f58-6d20-4081-8f88-8678f6f9280c tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:12.602933 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8a458f58-6d20-4081-8f88-8678f6f9280c tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:12.602933 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8a458f58-6d20-4081-8f88-8678f6f9280c tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:12.603743 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8a458f58-6d20-4081-8f88-8678f6f9280c tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:12.603942 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8a458f58-6d20-4081-8f88-8678f6f9280c tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:12.604655 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8a458f58-6d20-4081-8f88-8678f6f9280c tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:12.611542 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-a005447c-f1fa-48ab-8958-4ec3473b7350 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:12.629317 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-a005447c-f1fa-48ab-8958-4ec3473b7350 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1322 microversion: 2.1 time: 1.243521 Aug 26 00:54:12.629967 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 28/56] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:11 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1322 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:12.634798 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-29841e7f-1ecb-4734-bce7-2a9dc40b9973 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:12.635613 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-29841e7f-1ecb-4734-bce7-2a9dc40b9973 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:12.651797 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:54:12.653738 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-29841e7f-1ecb-4734-bce7-2a9dc40b9973 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:12.654268 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-29841e7f-1ecb-4734-bce7-2a9dc40b9973 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:12.654739 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-29841e7f-1ecb-4734-bce7-2a9dc40b9973 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:12.667551 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-29841e7f-1ecb-4734-bce7-2a9dc40b9973 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:12.668089 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-29841e7f-1ecb-4734-bce7-2a9dc40b9973 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:12.668557 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-29841e7f-1ecb-4734-bce7-2a9dc40b9973 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:12.837605 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-29841e7f-1ecb-4734-bce7-2a9dc40b9973 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:12.845876 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-29841e7f-1ecb-4734-bce7-2a9dc40b9973 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:12.857126 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-29841e7f-1ecb-4734-bce7-2a9dc40b9973 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:12.857126 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-29841e7f-1ecb-4734-bce7-2a9dc40b9973 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1338 microversion: 2.20 time: 0.224957 Aug 26 00:54:12.876737 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 29/57] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:54:12 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1338 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:54:12.894243 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-3c006219-a237-4d6e-94a1-a5941e2b210e tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:12.894875 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-3c006219-a237-4d6e-94a1-a5941e2b210e tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:12.911565 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3c006219-a237-4d6e-94a1-a5941e2b210e tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:12.913235 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3c006219-a237-4d6e-94a1-a5941e2b210e tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:12.913862 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3c006219-a237-4d6e-94a1-a5941e2b210e tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:12.914761 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3c006219-a237-4d6e-94a1-a5941e2b210e tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:12.915391 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3c006219-a237-4d6e-94a1-a5941e2b210e tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:12.916079 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3c006219-a237-4d6e-94a1-a5941e2b210e tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:13.066261 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-3c006219-a237-4d6e-94a1-a5941e2b210e tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:13.093710 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-3c006219-a237-4d6e-94a1-a5941e2b210e tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1295 microversion: 2.1 time: 0.213143 Aug 26 00:54:13.108851 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 30/58] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:12 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1295 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:13.223153 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-8a458f58-6d20-4081-8f88-8678f6f9280c tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a425027e59242bba6b05407d19cac82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032ed1b5aea842edb0bcae9d23810786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:13.245219 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-8a458f58-6d20-4081-8f88-8678f6f9280c tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] 10.222.0.59 "GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e" status: 200 len: 1314 microversion: 2.1 time: 0.674626 Aug 26 00:54:13.249056 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 29/59] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:12 2022] GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e => generated 1314 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:13.652944 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-6a356e51-dea2-4bd5-b95e-17c1b0d4a538 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:13.655922 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-6a356e51-dea2-4bd5-b95e-17c1b0d4a538 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:13.665825 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6a356e51-dea2-4bd5-b95e-17c1b0d4a538 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:13.666545 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6a356e51-dea2-4bd5-b95e-17c1b0d4a538 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:13.668187 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6a356e51-dea2-4bd5-b95e-17c1b0d4a538 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:13.669965 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6a356e51-dea2-4bd5-b95e-17c1b0d4a538 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:13.670795 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6a356e51-dea2-4bd5-b95e-17c1b0d4a538 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:13.673460 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6a356e51-dea2-4bd5-b95e-17c1b0d4a538 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:13.897717 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-9e1e4d0f-144e-4ad6-aaf8-99def5995d70 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:13.899210 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-9e1e4d0f-144e-4ad6-aaf8-99def5995d70 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:13.910459 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9e1e4d0f-144e-4ad6-aaf8-99def5995d70 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:13.912782 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9e1e4d0f-144e-4ad6-aaf8-99def5995d70 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:13.913909 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9e1e4d0f-144e-4ad6-aaf8-99def5995d70 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:13.920159 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9e1e4d0f-144e-4ad6-aaf8-99def5995d70 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:13.920159 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9e1e4d0f-144e-4ad6-aaf8-99def5995d70 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:13.920159 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9e1e4d0f-144e-4ad6-aaf8-99def5995d70 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:14.292506 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-6a356e51-dea2-4bd5-b95e-17c1b0d4a538 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:14.306374 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-9e1e4d0f-144e-4ad6-aaf8-99def5995d70 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:14.308602 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-6a356e51-dea2-4bd5-b95e-17c1b0d4a538 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1322 microversion: 2.1 time: 0.661126 Aug 26 00:54:14.311828 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 31/60] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:13 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1322 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:14.324733 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-412edbef-9c41-4661-a30c-4e3a2198bc63 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:14.324733 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-412edbef-9c41-4661-a30c-4e3a2198bc63 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:14.335032 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-9e1e4d0f-144e-4ad6-aaf8-99def5995d70 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:14.340864 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-9e1e4d0f-144e-4ad6-aaf8-99def5995d70 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:14.342112 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-412edbef-9c41-4661-a30c-4e3a2198bc63 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:14.342573 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-9e1e4d0f-144e-4ad6-aaf8-99def5995d70 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1406 microversion: 2.20 time: 0.454084 Aug 26 00:54:14.342689 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-412edbef-9c41-4661-a30c-4e3a2198bc63 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:14.343072 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-412edbef-9c41-4661-a30c-4e3a2198bc63 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:14.343745 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-412edbef-9c41-4661-a30c-4e3a2198bc63 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:14.345034 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 30/61] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:54:13 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1406 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:54:14.345158 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-412edbef-9c41-4661-a30c-4e3a2198bc63 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:14.345575 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-412edbef-9c41-4661-a30c-4e3a2198bc63 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:14.350457 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-259619c1-2be5-4eb3-ac16-ade2b0bcc81e tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:14.353547 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-259619c1-2be5-4eb3-ac16-ade2b0bcc81e tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] [instance: d778c4bb-8dd8-4106-b7cc-12a1d485cf1e] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:14.377243 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-259619c1-2be5-4eb3-ac16-ade2b0bcc81e tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:14.377243 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-259619c1-2be5-4eb3-ac16-ade2b0bcc81e tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:14.377243 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-259619c1-2be5-4eb3-ac16-ade2b0bcc81e tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:14.377552 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-259619c1-2be5-4eb3-ac16-ade2b0bcc81e tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:14.377969 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-259619c1-2be5-4eb3-ac16-ade2b0bcc81e tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:14.378585 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-259619c1-2be5-4eb3-ac16-ade2b0bcc81e tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:14.772362 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-412edbef-9c41-4661-a30c-4e3a2198bc63 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:14.786675 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell1:SELECT=100 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:54:14.794936 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-412edbef-9c41-4661-a30c-4e3a2198bc63 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1295 microversion: 2.1 time: 0.481887 Aug 26 00:54:14.801266 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 32/62] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:14 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1295 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:14.812274 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [req-c2a6271a-3f37-4bd7-ad26-246bc5962d0d req-df1f1714-ff72-4a7d-aad8-a9aafd424c67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d778c4bb-8dd8-4106-b7cc-12a1d485cf1e", "tag": "5f1c5b36-2ace-4432-8c74-20a3b6c61298"}]} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:54:14.838076 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-c2a6271a-3f37-4bd7-ad26-246bc5962d0d req-df1f1714-ff72-4a7d-aad8-a9aafd424c67 service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:14.838783 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-c2a6271a-3f37-4bd7-ad26-246bc5962d0d req-df1f1714-ff72-4a7d-aad8-a9aafd424c67 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:14.839383 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-c2a6271a-3f37-4bd7-ad26-246bc5962d0d req-df1f1714-ff72-4a7d-aad8-a9aafd424c67 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:14.871402 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.compute.server_external_events [req-c2a6271a-3f37-4bd7-ad26-246bc5962d0d req-df1f1714-ff72-4a7d-aad8-a9aafd424c67 service nova] Creating event network-changed:5f1c5b36-2ace-4432-8c74-20a3b6c61298 for instance d778c4bb-8dd8-4106-b7cc-12a1d485cf1e on hv-cinder-83538 Aug 26 00:54:14.884634 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [req-c2a6271a-3f37-4bd7-ad26-246bc5962d0d req-df1f1714-ff72-4a7d-aad8-a9aafd424c67 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077309 Aug 26 00:54:14.886857 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 33/63] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 00:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:54:15.122408 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-259619c1-2be5-4eb3-ac16-ade2b0bcc81e tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a425027e59242bba6b05407d19cac82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032ed1b5aea842edb0bcae9d23810786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:15.131229 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-259619c1-2be5-4eb3-ac16-ade2b0bcc81e tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] 10.222.0.59 "GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e" status: 200 len: 1314 microversion: 2.1 time: 0.784819 Aug 26 00:54:15.131813 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 31/64] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:14 2022] GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e => generated 1314 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:15.337533 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-8f4e96aa-a2d8-48b5-a2f2-37dd7bdbe619 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:15.338516 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-8f4e96aa-a2d8-48b5-a2f2-37dd7bdbe619 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:15.358335 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8f4e96aa-a2d8-48b5-a2f2-37dd7bdbe619 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:15.358829 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8f4e96aa-a2d8-48b5-a2f2-37dd7bdbe619 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:15.359510 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8f4e96aa-a2d8-48b5-a2f2-37dd7bdbe619 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:15.360800 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8f4e96aa-a2d8-48b5-a2f2-37dd7bdbe619 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:15.361356 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8f4e96aa-a2d8-48b5-a2f2-37dd7bdbe619 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:15.361787 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8f4e96aa-a2d8-48b5-a2f2-37dd7bdbe619 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:15.383106 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-188df026-9c6f-4e7d-a695-cd18131291a9 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:15.388889 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-188df026-9c6f-4e7d-a695-cd18131291a9 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:15.404825 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-188df026-9c6f-4e7d-a695-cd18131291a9 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:15.405686 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-188df026-9c6f-4e7d-a695-cd18131291a9 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:15.421095 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-188df026-9c6f-4e7d-a695-cd18131291a9 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:15.421929 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-188df026-9c6f-4e7d-a695-cd18131291a9 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:15.422413 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-188df026-9c6f-4e7d-a695-cd18131291a9 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:15.425478 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-188df026-9c6f-4e7d-a695-cd18131291a9 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:16.059291 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-188df026-9c6f-4e7d-a695-cd18131291a9 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:16.075808 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-188df026-9c6f-4e7d-a695-cd18131291a9 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:16.084011 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-188df026-9c6f-4e7d-a695-cd18131291a9 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:16.084011 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-188df026-9c6f-4e7d-a695-cd18131291a9 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1406 microversion: 2.20 time: 0.709567 Aug 26 00:54:16.100585 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 32/65] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:54:15 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1406 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:54:16.125719 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-260eca12-fed7-4c4a-85ec-0b99c7da917d tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:16.126793 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-260eca12-fed7-4c4a-85ec-0b99c7da917d tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:16.150973 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell0:SELECT=24 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:54:16.181596 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-260eca12-fed7-4c4a-85ec-0b99c7da917d tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:16.181596 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-260eca12-fed7-4c4a-85ec-0b99c7da917d tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:16.181596 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-260eca12-fed7-4c4a-85ec-0b99c7da917d tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:16.181596 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-260eca12-fed7-4c4a-85ec-0b99c7da917d tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:16.182215 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-260eca12-fed7-4c4a-85ec-0b99c7da917d tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:16.182215 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-260eca12-fed7-4c4a-85ec-0b99c7da917d tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:16.391919 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-8f4e96aa-a2d8-48b5-a2f2-37dd7bdbe619 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:16.410074 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-8f4e96aa-a2d8-48b5-a2f2-37dd7bdbe619 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1322 microversion: 2.1 time: 1.077828 Aug 26 00:54:16.439381 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 34/66] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:15 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1322 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:16.458015 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-2a4cb9c6-6af5-42f5-8440-c3b08cb766ca tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:16.462560 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-2a4cb9c6-6af5-42f5-8440-c3b08cb766ca tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] [instance: d778c4bb-8dd8-4106-b7cc-12a1d485cf1e] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:16.475225 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2a4cb9c6-6af5-42f5-8440-c3b08cb766ca tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:16.477031 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2a4cb9c6-6af5-42f5-8440-c3b08cb766ca tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:16.479225 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2a4cb9c6-6af5-42f5-8440-c3b08cb766ca tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:16.480369 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2a4cb9c6-6af5-42f5-8440-c3b08cb766ca tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:16.481534 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2a4cb9c6-6af5-42f5-8440-c3b08cb766ca tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:16.485663 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2a4cb9c6-6af5-42f5-8440-c3b08cb766ca tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:16.632411 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-260eca12-fed7-4c4a-85ec-0b99c7da917d tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:16.640582 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-260eca12-fed7-4c4a-85ec-0b99c7da917d tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1362 microversion: 2.1 time: 0.538755 Aug 26 00:54:16.642263 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 33/67] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:16 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1362 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:16.647420 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [req-6eb832fe-a875-466c-9899-0fad5ec49f73 req-6c028b7c-915a-44eb-89cf-d2ab8a6ec262 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7502d0cf-4abc-484b-8c85-d8ea6682333b", "tag": "ee6ad2fb-f57e-474d-a46b-a0d19ae36479"}]} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:54:16.657404 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-6eb832fe-a875-466c-9899-0fad5ec49f73 req-6c028b7c-915a-44eb-89cf-d2ab8a6ec262 service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:16.658011 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-6eb832fe-a875-466c-9899-0fad5ec49f73 req-6c028b7c-915a-44eb-89cf-d2ab8a6ec262 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:16.658498 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-6eb832fe-a875-466c-9899-0fad5ec49f73 req-6c028b7c-915a-44eb-89cf-d2ab8a6ec262 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:16.663616 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell1:SELECT=100 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:54:16.671300 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.compute.server_external_events [req-6eb832fe-a875-466c-9899-0fad5ec49f73 req-6c028b7c-915a-44eb-89cf-d2ab8a6ec262 service nova] Creating event network-changed:ee6ad2fb-f57e-474d-a46b-a0d19ae36479 for instance 7502d0cf-4abc-484b-8c85-d8ea6682333b on hv-cinder-83538 Aug 26 00:54:16.677306 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [req-6eb832fe-a875-466c-9899-0fad5ec49f73 req-6c028b7c-915a-44eb-89cf-d2ab8a6ec262 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033005 Aug 26 00:54:16.678158 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 34/68] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 00:54:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:54:16.792056 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-2a4cb9c6-6af5-42f5-8440-c3b08cb766ca tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a425027e59242bba6b05407d19cac82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032ed1b5aea842edb0bcae9d23810786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:16.800507 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-2a4cb9c6-6af5-42f5-8440-c3b08cb766ca tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] 10.222.0.59 "GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e" status: 200 len: 1314 microversion: 2.1 time: 0.359967 Aug 26 00:54:16.801117 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 35/69] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:16 2022] GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e => generated 1314 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:17.104034 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-152591af-9005-4759-9b2a-2ee34057fabe tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:17.104774 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-152591af-9005-4759-9b2a-2ee34057fabe tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:17.111401 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-152591af-9005-4759-9b2a-2ee34057fabe tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:17.111886 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-152591af-9005-4759-9b2a-2ee34057fabe tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:17.112515 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-152591af-9005-4759-9b2a-2ee34057fabe tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:17.113216 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-152591af-9005-4759-9b2a-2ee34057fabe tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:17.117135 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-152591af-9005-4759-9b2a-2ee34057fabe tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:17.117135 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-152591af-9005-4759-9b2a-2ee34057fabe tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:17.286691 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-152591af-9005-4759-9b2a-2ee34057fabe tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:17.286691 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-152591af-9005-4759-9b2a-2ee34057fabe tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:17.287423 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-152591af-9005-4759-9b2a-2ee34057fabe tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:17.287423 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-152591af-9005-4759-9b2a-2ee34057fabe tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1406 microversion: 2.20 time: 0.164131 Aug 26 00:54:17.287423 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 35/70] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:54:17 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 00:54:17.444980 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-d4ec0314-6e5c-41cd-90ba-a7bcc6cf5a6d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:17.445590 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-d4ec0314-6e5c-41cd-90ba-a7bcc6cf5a6d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:17.447574 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell0:SELECT=28 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:54:17.454945 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-d4ec0314-6e5c-41cd-90ba-a7bcc6cf5a6d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:17.454945 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-d4ec0314-6e5c-41cd-90ba-a7bcc6cf5a6d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:17.454945 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-d4ec0314-6e5c-41cd-90ba-a7bcc6cf5a6d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:17.454945 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-d4ec0314-6e5c-41cd-90ba-a7bcc6cf5a6d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:17.455415 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-d4ec0314-6e5c-41cd-90ba-a7bcc6cf5a6d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:17.455864 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-d4ec0314-6e5c-41cd-90ba-a7bcc6cf5a6d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:17.595919 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-d4ec0314-6e5c-41cd-90ba-a7bcc6cf5a6d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:17.604732 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-d4ec0314-6e5c-41cd-90ba-a7bcc6cf5a6d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1322 microversion: 2.1 time: 0.163410 Aug 26 00:54:17.605308 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 36/71] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:17 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:17.663414 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-ecaf8992-adff-4776-83c6-6f5b201b2447 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:17.663510 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-ecaf8992-adff-4776-83c6-6f5b201b2447 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:17.666581 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:54:17.669929 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ecaf8992-adff-4776-83c6-6f5b201b2447 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:17.670464 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ecaf8992-adff-4776-83c6-6f5b201b2447 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:17.670927 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ecaf8992-adff-4776-83c6-6f5b201b2447 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:17.671554 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ecaf8992-adff-4776-83c6-6f5b201b2447 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:17.672003 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ecaf8992-adff-4776-83c6-6f5b201b2447 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:17.672432 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ecaf8992-adff-4776-83c6-6f5b201b2447 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:17.799730 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-ecaf8992-adff-4776-83c6-6f5b201b2447 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:17.807439 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-ecaf8992-adff-4776-83c6-6f5b201b2447 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1362 microversion: 2.1 time: 0.149310 Aug 26 00:54:17.812411 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 36/72] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:17 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:17.821900 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-cdf073e4-51b0-4f35-885b-6eae3fbea2b8 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:17.822458 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-cdf073e4-51b0-4f35-885b-6eae3fbea2b8 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] [instance: d778c4bb-8dd8-4106-b7cc-12a1d485cf1e] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:17.831900 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-cdf073e4-51b0-4f35-885b-6eae3fbea2b8 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:17.832430 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-cdf073e4-51b0-4f35-885b-6eae3fbea2b8 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:17.833391 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-cdf073e4-51b0-4f35-885b-6eae3fbea2b8 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:17.834089 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-cdf073e4-51b0-4f35-885b-6eae3fbea2b8 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:17.834558 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-cdf073e4-51b0-4f35-885b-6eae3fbea2b8 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:17.835243 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-cdf073e4-51b0-4f35-885b-6eae3fbea2b8 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:17.965862 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-cdf073e4-51b0-4f35-885b-6eae3fbea2b8 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a425027e59242bba6b05407d19cac82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032ed1b5aea842edb0bcae9d23810786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:17.973614 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-cdf073e4-51b0-4f35-885b-6eae3fbea2b8 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] 10.222.0.59 "GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e" status: 200 len: 1314 microversion: 2.1 time: 0.155657 Aug 26 00:54:17.974170 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 37/73] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:17 2022] GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:18.307743 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-95042c02-b397-4ecb-982b-e45d6a02ca42 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:18.308989 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-95042c02-b397-4ecb-982b-e45d6a02ca42 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:18.317200 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-95042c02-b397-4ecb-982b-e45d6a02ca42 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:18.318661 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-95042c02-b397-4ecb-982b-e45d6a02ca42 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:18.319385 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-95042c02-b397-4ecb-982b-e45d6a02ca42 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:18.320361 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-95042c02-b397-4ecb-982b-e45d6a02ca42 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:18.321517 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-95042c02-b397-4ecb-982b-e45d6a02ca42 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:18.322391 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-95042c02-b397-4ecb-982b-e45d6a02ca42 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:18.479844 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-95042c02-b397-4ecb-982b-e45d6a02ca42 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:18.488608 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-95042c02-b397-4ecb-982b-e45d6a02ca42 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:18.490102 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-95042c02-b397-4ecb-982b-e45d6a02ca42 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:18.491406 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-95042c02-b397-4ecb-982b-e45d6a02ca42 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1406 microversion: 2.20 time: 0.187771 Aug 26 00:54:18.491962 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 37/74] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:54:18 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1406 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:54:18.632336 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-aa5292f0-ff71-4706-ac0b-5bbf56a54d85 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:18.634020 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-aa5292f0-ff71-4706-ac0b-5bbf56a54d85 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:18.644699 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-aa5292f0-ff71-4706-ac0b-5bbf56a54d85 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:18.645827 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-aa5292f0-ff71-4706-ac0b-5bbf56a54d85 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:18.646471 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-aa5292f0-ff71-4706-ac0b-5bbf56a54d85 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:18.647190 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-aa5292f0-ff71-4706-ac0b-5bbf56a54d85 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:18.647799 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-aa5292f0-ff71-4706-ac0b-5bbf56a54d85 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:18.648082 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-aa5292f0-ff71-4706-ac0b-5bbf56a54d85 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:18.809639 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-aa5292f0-ff71-4706-ac0b-5bbf56a54d85 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:18.827823 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-d3fa647e-c714-48d8-9d0d-512f14904e9d tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:18.834959 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-d3fa647e-c714-48d8-9d0d-512f14904e9d tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:18.835282 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-aa5292f0-ff71-4706-ac0b-5bbf56a54d85 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1322 microversion: 2.1 time: 0.206584 Aug 26 00:54:18.835282 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 38/75] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:18 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:18.846389 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d3fa647e-c714-48d8-9d0d-512f14904e9d tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:18.846940 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d3fa647e-c714-48d8-9d0d-512f14904e9d tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:18.847437 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d3fa647e-c714-48d8-9d0d-512f14904e9d tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:18.848844 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d3fa647e-c714-48d8-9d0d-512f14904e9d tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:18.849352 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d3fa647e-c714-48d8-9d0d-512f14904e9d tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:18.849838 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d3fa647e-c714-48d8-9d0d-512f14904e9d tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:18.994601 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-002bf1e0-19c8-4475-92fe-eaae0c9e9a3f tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:18.995622 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-002bf1e0-19c8-4475-92fe-eaae0c9e9a3f tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] [instance: d778c4bb-8dd8-4106-b7cc-12a1d485cf1e] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:19.003225 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-002bf1e0-19c8-4475-92fe-eaae0c9e9a3f tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:19.004107 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-002bf1e0-19c8-4475-92fe-eaae0c9e9a3f tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:19.008347 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-002bf1e0-19c8-4475-92fe-eaae0c9e9a3f tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:19.009426 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-002bf1e0-19c8-4475-92fe-eaae0c9e9a3f tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:19.010051 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-002bf1e0-19c8-4475-92fe-eaae0c9e9a3f tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:19.010626 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-002bf1e0-19c8-4475-92fe-eaae0c9e9a3f tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:19.041983 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-d3fa647e-c714-48d8-9d0d-512f14904e9d tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:19.059726 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-d3fa647e-c714-48d8-9d0d-512f14904e9d tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1362 microversion: 2.1 time: 0.236280 Aug 26 00:54:19.064573 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 38/76] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:18 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1362 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:19.262572 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-002bf1e0-19c8-4475-92fe-eaae0c9e9a3f tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a425027e59242bba6b05407d19cac82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032ed1b5aea842edb0bcae9d23810786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:19.271665 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-002bf1e0-19c8-4475-92fe-eaae0c9e9a3f tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] 10.222.0.59 "GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e" status: 200 len: 1314 microversion: 2.1 time: 0.281502 Aug 26 00:54:19.273689 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 39/77] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:18 2022] GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:54:19.517744 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-fca58d6e-ba1f-417d-bd41-29148b1f3f4a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:19.519073 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-fca58d6e-ba1f-417d-bd41-29148b1f3f4a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:19.526852 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-fca58d6e-ba1f-417d-bd41-29148b1f3f4a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:19.527924 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-fca58d6e-ba1f-417d-bd41-29148b1f3f4a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:19.528947 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-fca58d6e-ba1f-417d-bd41-29148b1f3f4a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:19.530009 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-fca58d6e-ba1f-417d-bd41-29148b1f3f4a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:19.530632 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-fca58d6e-ba1f-417d-bd41-29148b1f3f4a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:19.531217 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-fca58d6e-ba1f-417d-bd41-29148b1f3f4a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:19.702545 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-fca58d6e-ba1f-417d-bd41-29148b1f3f4a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:19.712356 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-fca58d6e-ba1f-417d-bd41-29148b1f3f4a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:19.726095 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-fca58d6e-ba1f-417d-bd41-29148b1f3f4a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:19.726095 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-fca58d6e-ba1f-417d-bd41-29148b1f3f4a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1406 microversion: 2.20 time: 0.204915 Aug 26 00:54:19.726095 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 39/78] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:54:19 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1406 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:54:19.853312 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-cf06110c-f060-48f0-8280-94501cf900da tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:19.853923 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-cf06110c-f060-48f0-8280-94501cf900da tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:19.859857 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-cf06110c-f060-48f0-8280-94501cf900da tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:19.860344 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-cf06110c-f060-48f0-8280-94501cf900da tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:19.860814 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-cf06110c-f060-48f0-8280-94501cf900da tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:19.861532 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-cf06110c-f060-48f0-8280-94501cf900da tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:19.861985 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-cf06110c-f060-48f0-8280-94501cf900da tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:19.862410 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-cf06110c-f060-48f0-8280-94501cf900da tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:20.064192 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-cf06110c-f060-48f0-8280-94501cf900da tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:20.072363 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-cf06110c-f060-48f0-8280-94501cf900da tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1322 microversion: 2.1 time: 0.222876 Aug 26 00:54:20.072948 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 40/79] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:19 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:20.080918 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-11a0100b-9213-4c61-9367-f2596745e038 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:20.081612 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-11a0100b-9213-4c61-9367-f2596745e038 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:20.087550 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-11a0100b-9213-4c61-9367-f2596745e038 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:20.088101 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-11a0100b-9213-4c61-9367-f2596745e038 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:20.088664 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-11a0100b-9213-4c61-9367-f2596745e038 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:20.089434 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-11a0100b-9213-4c61-9367-f2596745e038 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:20.089890 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-11a0100b-9213-4c61-9367-f2596745e038 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:20.090308 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-11a0100b-9213-4c61-9367-f2596745e038 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:20.237621 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-11a0100b-9213-4c61-9367-f2596745e038 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:20.246610 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-11a0100b-9213-4c61-9367-f2596745e038 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1362 microversion: 2.1 time: 0.169373 Aug 26 00:54:20.263667 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 40/80] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:20 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:20.295445 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-772b8f93-d5d4-43e7-83eb-0e1d0abf75dc tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:20.296053 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-772b8f93-d5d4-43e7-83eb-0e1d0abf75dc tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] [instance: d778c4bb-8dd8-4106-b7cc-12a1d485cf1e] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:20.302691 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-772b8f93-d5d4-43e7-83eb-0e1d0abf75dc tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:20.303170 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-772b8f93-d5d4-43e7-83eb-0e1d0abf75dc tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:20.303672 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-772b8f93-d5d4-43e7-83eb-0e1d0abf75dc tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:20.304358 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-772b8f93-d5d4-43e7-83eb-0e1d0abf75dc tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:20.304834 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-772b8f93-d5d4-43e7-83eb-0e1d0abf75dc tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:20.305784 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-772b8f93-d5d4-43e7-83eb-0e1d0abf75dc tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:20.452144 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-772b8f93-d5d4-43e7-83eb-0e1d0abf75dc tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a425027e59242bba6b05407d19cac82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032ed1b5aea842edb0bcae9d23810786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:20.460329 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-772b8f93-d5d4-43e7-83eb-0e1d0abf75dc tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] 10.222.0.59 "GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e" status: 200 len: 1314 microversion: 2.1 time: 0.169013 Aug 26 00:54:20.460925 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 41/81] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:20 2022] GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:20.746044 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-eb71ffa2-5725-4014-84b4-670b45d1b3ea tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:20.746563 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-eb71ffa2-5725-4014-84b4-670b45d1b3ea tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:20.752850 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-eb71ffa2-5725-4014-84b4-670b45d1b3ea tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:20.753334 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-eb71ffa2-5725-4014-84b4-670b45d1b3ea tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:20.753768 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-eb71ffa2-5725-4014-84b4-670b45d1b3ea tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:20.754450 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-eb71ffa2-5725-4014-84b4-670b45d1b3ea tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:20.755074 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-eb71ffa2-5725-4014-84b4-670b45d1b3ea tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:20.755318 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-eb71ffa2-5725-4014-84b4-670b45d1b3ea tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:20.924897 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-eb71ffa2-5725-4014-84b4-670b45d1b3ea tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:20.933144 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-eb71ffa2-5725-4014-84b4-670b45d1b3ea tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:20.934590 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-eb71ffa2-5725-4014-84b4-670b45d1b3ea tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:20.935698 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-eb71ffa2-5725-4014-84b4-670b45d1b3ea tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1406 microversion: 2.20 time: 0.193576 Aug 26 00:54:20.936263 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 41/82] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:54:20 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1406 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:54:21.100108 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-dd88e360-6761-4e74-94c1-66ba4faf3e1e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:21.101607 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-dd88e360-6761-4e74-94c1-66ba4faf3e1e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:21.113503 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell0:SELECT=8 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:54:21.116046 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-dd88e360-6761-4e74-94c1-66ba4faf3e1e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:21.116761 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-dd88e360-6761-4e74-94c1-66ba4faf3e1e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:21.122285 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-dd88e360-6761-4e74-94c1-66ba4faf3e1e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:21.122285 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-dd88e360-6761-4e74-94c1-66ba4faf3e1e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:21.122285 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-dd88e360-6761-4e74-94c1-66ba4faf3e1e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:21.122285 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-dd88e360-6761-4e74-94c1-66ba4faf3e1e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:21.271388 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-33fe0712-4f5a-480e-a424-e3b2bc368c30 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:21.272003 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-33fe0712-4f5a-480e-a424-e3b2bc368c30 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:21.278411 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-33fe0712-4f5a-480e-a424-e3b2bc368c30 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:21.315197 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-33fe0712-4f5a-480e-a424-e3b2bc368c30 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:21.315197 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-33fe0712-4f5a-480e-a424-e3b2bc368c30 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:21.315197 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-33fe0712-4f5a-480e-a424-e3b2bc368c30 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:21.315197 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-33fe0712-4f5a-480e-a424-e3b2bc368c30 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:21.315822 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-33fe0712-4f5a-480e-a424-e3b2bc368c30 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:21.316092 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-dd88e360-6761-4e74-94c1-66ba4faf3e1e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:21.316092 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-dd88e360-6761-4e74-94c1-66ba4faf3e1e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1322 microversion: 2.1 time: 0.209877 Aug 26 00:54:21.316092 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 42/83] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:21 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:21.454743 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-33fe0712-4f5a-480e-a424-e3b2bc368c30 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:21.465831 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-33fe0712-4f5a-480e-a424-e3b2bc368c30 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1362 microversion: 2.1 time: 0.198606 Aug 26 00:54:21.467138 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 42/84] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:21 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1362 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:21.481864 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-83a5b11d-9c59-46b1-a397-763f72df6aa7 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:21.482725 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-83a5b11d-9c59-46b1-a397-763f72df6aa7 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] [instance: d778c4bb-8dd8-4106-b7cc-12a1d485cf1e] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:21.490078 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-83a5b11d-9c59-46b1-a397-763f72df6aa7 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:21.490611 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-83a5b11d-9c59-46b1-a397-763f72df6aa7 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:21.491224 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-83a5b11d-9c59-46b1-a397-763f72df6aa7 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:21.492080 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-83a5b11d-9c59-46b1-a397-763f72df6aa7 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:21.492557 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-83a5b11d-9c59-46b1-a397-763f72df6aa7 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:21.492994 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-83a5b11d-9c59-46b1-a397-763f72df6aa7 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:21.633271 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-83a5b11d-9c59-46b1-a397-763f72df6aa7 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a425027e59242bba6b05407d19cac82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032ed1b5aea842edb0bcae9d23810786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:21.640892 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-83a5b11d-9c59-46b1-a397-763f72df6aa7 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] 10.222.0.59 "GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e" status: 200 len: 1314 microversion: 2.1 time: 0.163684 Aug 26 00:54:21.641462 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 43/85] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:21 2022] GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:21.956914 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-20e4d9ce-1bdc-4ed0-9fb9-fffd5c2148b5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:21.957376 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-20e4d9ce-1bdc-4ed0-9fb9-fffd5c2148b5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:21.963513 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-20e4d9ce-1bdc-4ed0-9fb9-fffd5c2148b5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:21.963994 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-20e4d9ce-1bdc-4ed0-9fb9-fffd5c2148b5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:21.964428 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-20e4d9ce-1bdc-4ed0-9fb9-fffd5c2148b5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:21.965150 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-20e4d9ce-1bdc-4ed0-9fb9-fffd5c2148b5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:21.965601 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-20e4d9ce-1bdc-4ed0-9fb9-fffd5c2148b5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:21.966023 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-20e4d9ce-1bdc-4ed0-9fb9-fffd5c2148b5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:22.161905 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-20e4d9ce-1bdc-4ed0-9fb9-fffd5c2148b5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:22.173906 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-20e4d9ce-1bdc-4ed0-9fb9-fffd5c2148b5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:22.178184 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-20e4d9ce-1bdc-4ed0-9fb9-fffd5c2148b5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:22.182014 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-20e4d9ce-1bdc-4ed0-9fb9-fffd5c2148b5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1406 microversion: 2.20 time: 0.228905 Aug 26 00:54:22.197889 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 43/86] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:54:21 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1406 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:54:22.337302 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-2f6bf2c4-26d9-49c0-9b69-7b22e0a17dd2 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:22.341583 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-2f6bf2c4-26d9-49c0-9b69-7b22e0a17dd2 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:22.357735 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2f6bf2c4-26d9-49c0-9b69-7b22e0a17dd2 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:22.359679 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2f6bf2c4-26d9-49c0-9b69-7b22e0a17dd2 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:22.360905 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2f6bf2c4-26d9-49c0-9b69-7b22e0a17dd2 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:22.361812 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2f6bf2c4-26d9-49c0-9b69-7b22e0a17dd2 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:22.363405 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2f6bf2c4-26d9-49c0-9b69-7b22e0a17dd2 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:22.364366 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2f6bf2c4-26d9-49c0-9b69-7b22e0a17dd2 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:22.486123 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-e7714d6f-8531-4b63-886a-04a8a87693b9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:22.487348 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-e7714d6f-8531-4b63-886a-04a8a87693b9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:22.517492 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e7714d6f-8531-4b63-886a-04a8a87693b9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:22.518207 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e7714d6f-8531-4b63-886a-04a8a87693b9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:22.519300 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e7714d6f-8531-4b63-886a-04a8a87693b9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:22.522615 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e7714d6f-8531-4b63-886a-04a8a87693b9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:22.523258 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e7714d6f-8531-4b63-886a-04a8a87693b9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:22.524013 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e7714d6f-8531-4b63-886a-04a8a87693b9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:22.532853 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell0:SELECT=4 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:54:22.653359 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-2f6bf2c4-26d9-49c0-9b69-7b22e0a17dd2 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:22.666639 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-2f6bf2c4-26d9-49c0-9b69-7b22e0a17dd2 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1322 microversion: 2.1 time: 0.338987 Aug 26 00:54:22.667224 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 44/87] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:22 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1322 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:22.672728 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-668a1d52-e232-4a7e-8634-d50931a6ba08 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:22.673575 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-668a1d52-e232-4a7e-8634-d50931a6ba08 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] [instance: d778c4bb-8dd8-4106-b7cc-12a1d485cf1e] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:22.680938 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-668a1d52-e232-4a7e-8634-d50931a6ba08 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:22.681642 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-668a1d52-e232-4a7e-8634-d50931a6ba08 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:22.688092 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-668a1d52-e232-4a7e-8634-d50931a6ba08 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:22.688092 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-668a1d52-e232-4a7e-8634-d50931a6ba08 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:22.688092 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-668a1d52-e232-4a7e-8634-d50931a6ba08 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:22.688092 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-668a1d52-e232-4a7e-8634-d50931a6ba08 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:22.809566 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-e7714d6f-8531-4b63-886a-04a8a87693b9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:22.818645 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-e7714d6f-8531-4b63-886a-04a8a87693b9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1362 microversion: 2.1 time: 0.336181 Aug 26 00:54:22.819432 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 44/88] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:22 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1362 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:54:22.845532 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-668a1d52-e232-4a7e-8634-d50931a6ba08 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a425027e59242bba6b05407d19cac82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032ed1b5aea842edb0bcae9d23810786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:22.853601 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-668a1d52-e232-4a7e-8634-d50931a6ba08 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] 10.222.0.59 "GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e" status: 200 len: 1314 microversion: 2.1 time: 0.185172 Aug 26 00:54:22.854179 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 45/89] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:22 2022] GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:23.206362 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-1b3e096c-3939-4a46-8b97-8e1de8c9d69f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:23.207035 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-1b3e096c-3939-4a46-8b97-8e1de8c9d69f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:23.213152 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1b3e096c-3939-4a46-8b97-8e1de8c9d69f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:23.213628 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1b3e096c-3939-4a46-8b97-8e1de8c9d69f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:23.214053 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1b3e096c-3939-4a46-8b97-8e1de8c9d69f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:23.214725 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1b3e096c-3939-4a46-8b97-8e1de8c9d69f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:23.215167 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1b3e096c-3939-4a46-8b97-8e1de8c9d69f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:23.215580 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1b3e096c-3939-4a46-8b97-8e1de8c9d69f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:23.293342 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [req-790a6973-a633-4af5-aaac-15ce647d5021 req-7d7b1aac-a1e0-4053-9336-39ffd5b67ca9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "730816fc-0c43-43e3-ab6e-e7f324e403d7", "tag": "9a9a5c66-fe0c-40d8-ae1a-65494e24310f"}]} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:54:23.321156 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-790a6973-a633-4af5-aaac-15ce647d5021 req-7d7b1aac-a1e0-4053-9336-39ffd5b67ca9 service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:23.321769 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-790a6973-a633-4af5-aaac-15ce647d5021 req-7d7b1aac-a1e0-4053-9336-39ffd5b67ca9 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:23.323528 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-790a6973-a633-4af5-aaac-15ce647d5021 req-7d7b1aac-a1e0-4053-9336-39ffd5b67ca9 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:23.337934 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.compute.server_external_events [req-790a6973-a633-4af5-aaac-15ce647d5021 req-7d7b1aac-a1e0-4053-9336-39ffd5b67ca9 service nova] Creating event network-changed:9a9a5c66-fe0c-40d8-ae1a-65494e24310f for instance 730816fc-0c43-43e3-ab6e-e7f324e403d7 on hv-cinder-83538 Aug 26 00:54:23.345567 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [req-790a6973-a633-4af5-aaac-15ce647d5021 req-7d7b1aac-a1e0-4053-9336-39ffd5b67ca9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062440 Aug 26 00:54:23.346526 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 46/90] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 00:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:54:23.425154 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-1b3e096c-3939-4a46-8b97-8e1de8c9d69f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:23.425154 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-1b3e096c-3939-4a46-8b97-8e1de8c9d69f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:23.426225 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-1b3e096c-3939-4a46-8b97-8e1de8c9d69f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:23.428199 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-1b3e096c-3939-4a46-8b97-8e1de8c9d69f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1406 microversion: 2.20 time: 0.225685 Aug 26 00:54:23.428812 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 45/91] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:54:23 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1406 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:54:23.687790 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-2cd603c9-e8c2-4032-82cd-6ff157cb0a5b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:23.688504 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-2cd603c9-e8c2-4032-82cd-6ff157cb0a5b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:23.694602 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2cd603c9-e8c2-4032-82cd-6ff157cb0a5b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:23.695087 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2cd603c9-e8c2-4032-82cd-6ff157cb0a5b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:23.695518 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2cd603c9-e8c2-4032-82cd-6ff157cb0a5b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:23.696208 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2cd603c9-e8c2-4032-82cd-6ff157cb0a5b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:23.696692 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2cd603c9-e8c2-4032-82cd-6ff157cb0a5b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:23.697120 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2cd603c9-e8c2-4032-82cd-6ff157cb0a5b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:23.828111 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-2cd603c9-e8c2-4032-82cd-6ff157cb0a5b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:23.836746 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-2cd603c9-e8c2-4032-82cd-6ff157cb0a5b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1322 microversion: 2.1 time: 0.153076 Aug 26 00:54:23.837510 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 47/92] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:23 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:23.840028 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-7fe64ae6-53a0-49f0-a8ee-4807cfc21283 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:23.840666 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-7fe64ae6-53a0-49f0-a8ee-4807cfc21283 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:23.846652 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7fe64ae6-53a0-49f0-a8ee-4807cfc21283 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:23.847160 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7fe64ae6-53a0-49f0-a8ee-4807cfc21283 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:23.847596 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7fe64ae6-53a0-49f0-a8ee-4807cfc21283 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:23.849041 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7fe64ae6-53a0-49f0-a8ee-4807cfc21283 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:23.849471 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7fe64ae6-53a0-49f0-a8ee-4807cfc21283 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:23.849892 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7fe64ae6-53a0-49f0-a8ee-4807cfc21283 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:23.874947 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-f8a14381-6709-4acf-a931-8729a46ac5ef tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:23.875689 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-f8a14381-6709-4acf-a931-8729a46ac5ef tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] [instance: d778c4bb-8dd8-4106-b7cc-12a1d485cf1e] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:23.882064 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f8a14381-6709-4acf-a931-8729a46ac5ef tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:23.882549 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f8a14381-6709-4acf-a931-8729a46ac5ef tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:23.882983 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f8a14381-6709-4acf-a931-8729a46ac5ef tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:23.883667 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f8a14381-6709-4acf-a931-8729a46ac5ef tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:23.884138 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f8a14381-6709-4acf-a931-8729a46ac5ef tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:23.884583 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f8a14381-6709-4acf-a931-8729a46ac5ef tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:24.008014 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-7fe64ae6-53a0-49f0-a8ee-4807cfc21283 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:24.017024 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-7fe64ae6-53a0-49f0-a8ee-4807cfc21283 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1362 microversion: 2.1 time: 0.181290 Aug 26 00:54:24.018466 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 46/93] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:23 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:24.052956 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-f8a14381-6709-4acf-a931-8729a46ac5ef tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a425027e59242bba6b05407d19cac82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032ed1b5aea842edb0bcae9d23810786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:24.062985 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-f8a14381-6709-4acf-a931-8729a46ac5ef tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] 10.222.0.59 "GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e" status: 200 len: 1314 microversion: 2.1 time: 0.191559 Aug 26 00:54:24.074550 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 48/94] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:23 2022] GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:54:24.450111 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-336ceb9e-e9c0-41da-a6bc-0bb8fa1bc5b3 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:24.450722 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-336ceb9e-e9c0-41da-a6bc-0bb8fa1bc5b3 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:24.456689 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-336ceb9e-e9c0-41da-a6bc-0bb8fa1bc5b3 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:24.457170 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-336ceb9e-e9c0-41da-a6bc-0bb8fa1bc5b3 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:24.458146 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-336ceb9e-e9c0-41da-a6bc-0bb8fa1bc5b3 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:24.458811 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-336ceb9e-e9c0-41da-a6bc-0bb8fa1bc5b3 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:24.459262 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-336ceb9e-e9c0-41da-a6bc-0bb8fa1bc5b3 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:24.459679 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-336ceb9e-e9c0-41da-a6bc-0bb8fa1bc5b3 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:24.606669 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-336ceb9e-e9c0-41da-a6bc-0bb8fa1bc5b3 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:24.615224 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-336ceb9e-e9c0-41da-a6bc-0bb8fa1bc5b3 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:24.616718 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-336ceb9e-e9c0-41da-a6bc-0bb8fa1bc5b3 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:24.617975 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-336ceb9e-e9c0-41da-a6bc-0bb8fa1bc5b3 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1406 microversion: 2.20 time: 0.171788 Aug 26 00:54:24.618696 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 47/95] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:54:24 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:54:24.858811 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-e12be444-4f39-4e1f-9990-756cfbb38469 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:24.859428 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-e12be444-4f39-4e1f-9990-756cfbb38469 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:24.866215 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e12be444-4f39-4e1f-9990-756cfbb38469 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:24.866695 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e12be444-4f39-4e1f-9990-756cfbb38469 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:24.867156 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e12be444-4f39-4e1f-9990-756cfbb38469 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:24.867882 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e12be444-4f39-4e1f-9990-756cfbb38469 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:24.868338 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e12be444-4f39-4e1f-9990-756cfbb38469 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:24.868800 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e12be444-4f39-4e1f-9990-756cfbb38469 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:25.000501 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-e12be444-4f39-4e1f-9990-756cfbb38469 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:25.013396 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-e12be444-4f39-4e1f-9990-756cfbb38469 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1322 microversion: 2.1 time: 0.158006 Aug 26 00:54:25.025637 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 49/96] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:24 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:25.044516 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-02591712-99a8-4fd7-b7c4-cb8c7053495a tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:25.045283 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-02591712-99a8-4fd7-b7c4-cb8c7053495a tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:25.052055 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-02591712-99a8-4fd7-b7c4-cb8c7053495a tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:25.052579 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-02591712-99a8-4fd7-b7c4-cb8c7053495a tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:25.053013 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-02591712-99a8-4fd7-b7c4-cb8c7053495a tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:25.053710 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-02591712-99a8-4fd7-b7c4-cb8c7053495a tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:25.054153 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-02591712-99a8-4fd7-b7c4-cb8c7053495a tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:25.054570 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-02591712-99a8-4fd7-b7c4-cb8c7053495a tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:25.085485 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-6ccc70de-e713-40f5-a876-065b018f26d2 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:25.086394 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-6ccc70de-e713-40f5-a876-065b018f26d2 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] [instance: d778c4bb-8dd8-4106-b7cc-12a1d485cf1e] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:25.093952 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6ccc70de-e713-40f5-a876-065b018f26d2 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:25.094630 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6ccc70de-e713-40f5-a876-065b018f26d2 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:25.095236 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6ccc70de-e713-40f5-a876-065b018f26d2 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:25.096079 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6ccc70de-e713-40f5-a876-065b018f26d2 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:25.096695 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6ccc70de-e713-40f5-a876-065b018f26d2 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:25.097256 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6ccc70de-e713-40f5-a876-065b018f26d2 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:25.436628 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-02591712-99a8-4fd7-b7c4-cb8c7053495a tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:25.436628 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-02591712-99a8-4fd7-b7c4-cb8c7053495a tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1362 microversion: 2.1 time: 0.374307 Aug 26 00:54:25.436628 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 48/97] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:25 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1362 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:25.639858 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-6c3f0607-947a-4db8-9cf3-6552dbe101dc tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:26.385158 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-6c3f0607-947a-4db8-9cf3-6552dbe101dc tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:26.385158 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6c3f0607-947a-4db8-9cf3-6552dbe101dc tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:26.385158 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6c3f0607-947a-4db8-9cf3-6552dbe101dc tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:26.385158 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6c3f0607-947a-4db8-9cf3-6552dbe101dc tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:26.386710 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6c3f0607-947a-4db8-9cf3-6552dbe101dc tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:26.386710 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6c3f0607-947a-4db8-9cf3-6552dbe101dc tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:26.386710 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6c3f0607-947a-4db8-9cf3-6552dbe101dc tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:26.393776 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-6ccc70de-e713-40f5-a876-065b018f26d2 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a425027e59242bba6b05407d19cac82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032ed1b5aea842edb0bcae9d23810786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:26.393776 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell1:SELECT=100 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:54:26.393776 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-6ccc70de-e713-40f5-a876-065b018f26d2 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] 10.222.0.59 "GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e" status: 200 len: 1314 microversion: 2.1 time: 0.616129 Aug 26 00:54:26.393776 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 50/98] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:25 2022] GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e => generated 1314 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:54:26.396161 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-6c3f0607-947a-4db8-9cf3-6552dbe101dc tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:26.396161 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-6c3f0607-947a-4db8-9cf3-6552dbe101dc tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:26.396902 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-6c3f0607-947a-4db8-9cf3-6552dbe101dc tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:26.396902 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-6c3f0607-947a-4db8-9cf3-6552dbe101dc tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1406 microversion: 2.20 time: 0.258971 Aug 26 00:54:26.396902 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 49/99] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:54:25 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1406 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:54:26.397723 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-42b1c48a-d8de-453d-b0b7-511470c63f13 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:26.397723 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-42b1c48a-d8de-453d-b0b7-511470c63f13 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:26.397723 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-42b1c48a-d8de-453d-b0b7-511470c63f13 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:26.397723 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-42b1c48a-d8de-453d-b0b7-511470c63f13 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:26.398256 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-42b1c48a-d8de-453d-b0b7-511470c63f13 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:26.398256 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-42b1c48a-d8de-453d-b0b7-511470c63f13 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:26.398256 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-42b1c48a-d8de-453d-b0b7-511470c63f13 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:26.398256 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-42b1c48a-d8de-453d-b0b7-511470c63f13 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:26.398681 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-42b1c48a-d8de-453d-b0b7-511470c63f13 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:26.398681 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-42b1c48a-d8de-453d-b0b7-511470c63f13 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1322 microversion: 2.1 time: 0.236426 Aug 26 00:54:26.398681 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 51/100] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:26 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1322 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:54:26.453955 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-9a5c271d-f2a8-4d34-838a-fc86bfb8c513 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:26.454961 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-9a5c271d-f2a8-4d34-838a-fc86bfb8c513 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:26.462379 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9a5c271d-f2a8-4d34-838a-fc86bfb8c513 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:26.463848 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9a5c271d-f2a8-4d34-838a-fc86bfb8c513 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:26.464666 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9a5c271d-f2a8-4d34-838a-fc86bfb8c513 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:26.465050 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9a5c271d-f2a8-4d34-838a-fc86bfb8c513 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:26.465507 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9a5c271d-f2a8-4d34-838a-fc86bfb8c513 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:26.466018 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9a5c271d-f2a8-4d34-838a-fc86bfb8c513 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:26.647825 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-9a5c271d-f2a8-4d34-838a-fc86bfb8c513 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:26.655692 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-9a5c271d-f2a8-4d34-838a-fc86bfb8c513 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1362 microversion: 2.1 time: 0.207633 Aug 26 00:54:26.658725 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 50/101] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:26 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1362 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:26.718358 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-e473676b-7234-4701-b67e-460b6f7080bf tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:26.720071 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-e473676b-7234-4701-b67e-460b6f7080bf tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] [instance: d778c4bb-8dd8-4106-b7cc-12a1d485cf1e] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:26.725647 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e473676b-7234-4701-b67e-460b6f7080bf tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:26.726128 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e473676b-7234-4701-b67e-460b6f7080bf tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:26.726562 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e473676b-7234-4701-b67e-460b6f7080bf tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:26.727239 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e473676b-7234-4701-b67e-460b6f7080bf tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:26.727688 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e473676b-7234-4701-b67e-460b6f7080bf tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:26.728107 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e473676b-7234-4701-b67e-460b6f7080bf tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:26.880873 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-e473676b-7234-4701-b67e-460b6f7080bf tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a425027e59242bba6b05407d19cac82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032ed1b5aea842edb0bcae9d23810786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:26.889544 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-e473676b-7234-4701-b67e-460b6f7080bf tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] 10.222.0.59 "GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e" status: 200 len: 1314 microversion: 2.1 time: 0.174864 Aug 26 00:54:26.890694 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 52/102] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:26 2022] GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:26.919305 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-9d13311c-3047-498e-a056-12913002607f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:26.919833 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-9d13311c-3047-498e-a056-12913002607f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:26.926295 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9d13311c-3047-498e-a056-12913002607f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:26.927136 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9d13311c-3047-498e-a056-12913002607f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:26.927723 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9d13311c-3047-498e-a056-12913002607f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:26.928609 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9d13311c-3047-498e-a056-12913002607f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:26.932319 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9d13311c-3047-498e-a056-12913002607f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:26.932319 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9d13311c-3047-498e-a056-12913002607f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:26.948831 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell1:SELECT=100 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:54:27.062268 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-9d13311c-3047-498e-a056-12913002607f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:27.069835 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-9d13311c-3047-498e-a056-12913002607f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:27.071269 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-9d13311c-3047-498e-a056-12913002607f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:27.072381 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-9d13311c-3047-498e-a056-12913002607f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1406 microversion: 2.20 time: 0.156989 Aug 26 00:54:27.072997 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 51/103] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:54:26 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:54:27.353633 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-17073115-7b52-4573-ac18-e958cc21711e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:27.354481 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-17073115-7b52-4573-ac18-e958cc21711e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:27.364450 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-17073115-7b52-4573-ac18-e958cc21711e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:27.365143 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-17073115-7b52-4573-ac18-e958cc21711e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:27.365729 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-17073115-7b52-4573-ac18-e958cc21711e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:27.366616 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-17073115-7b52-4573-ac18-e958cc21711e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:27.367553 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-17073115-7b52-4573-ac18-e958cc21711e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:27.367988 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-17073115-7b52-4573-ac18-e958cc21711e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:27.520019 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-17073115-7b52-4573-ac18-e958cc21711e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:27.527645 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-17073115-7b52-4573-ac18-e958cc21711e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1322 microversion: 2.1 time: 0.177893 Aug 26 00:54:27.528212 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 53/104] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:27 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:27.678980 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-98018e7a-c8f6-47b6-ad2d-642e8b4e60ae tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:27.679622 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-98018e7a-c8f6-47b6-ad2d-642e8b4e60ae tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:27.685677 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-98018e7a-c8f6-47b6-ad2d-642e8b4e60ae tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:27.686153 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-98018e7a-c8f6-47b6-ad2d-642e8b4e60ae tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:27.686582 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-98018e7a-c8f6-47b6-ad2d-642e8b4e60ae tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:27.687266 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-98018e7a-c8f6-47b6-ad2d-642e8b4e60ae tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:27.687710 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-98018e7a-c8f6-47b6-ad2d-642e8b4e60ae tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:27.688127 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-98018e7a-c8f6-47b6-ad2d-642e8b4e60ae tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:27.821191 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-98018e7a-c8f6-47b6-ad2d-642e8b4e60ae tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:27.828693 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-98018e7a-c8f6-47b6-ad2d-642e8b4e60ae tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1362 microversion: 2.1 time: 0.154007 Aug 26 00:54:27.835124 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 52/105] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:27 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:27.910135 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-9b4ec80b-c331-4a16-a7c7-f6d5e8aa4d3e tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:27.911305 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-9b4ec80b-c331-4a16-a7c7-f6d5e8aa4d3e tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] [instance: d778c4bb-8dd8-4106-b7cc-12a1d485cf1e] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:27.918192 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9b4ec80b-c331-4a16-a7c7-f6d5e8aa4d3e tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:27.918823 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9b4ec80b-c331-4a16-a7c7-f6d5e8aa4d3e tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:27.919317 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9b4ec80b-c331-4a16-a7c7-f6d5e8aa4d3e tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:27.920048 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9b4ec80b-c331-4a16-a7c7-f6d5e8aa4d3e tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:27.920517 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9b4ec80b-c331-4a16-a7c7-f6d5e8aa4d3e tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:27.924727 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9b4ec80b-c331-4a16-a7c7-f6d5e8aa4d3e tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:28.053660 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-9b4ec80b-c331-4a16-a7c7-f6d5e8aa4d3e tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a425027e59242bba6b05407d19cac82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032ed1b5aea842edb0bcae9d23810786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:28.058839 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-9b4ec80b-c331-4a16-a7c7-f6d5e8aa4d3e tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] 10.222.0.59 "GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e" status: 200 len: 1314 microversion: 2.1 time: 0.152617 Aug 26 00:54:28.059578 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 54/106] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:27 2022] GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:28.095078 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-e984b1a1-72e2-4b1b-ba4b-0a4d9fd19c8b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:28.095717 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-e984b1a1-72e2-4b1b-ba4b-0a4d9fd19c8b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:28.101701 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e984b1a1-72e2-4b1b-ba4b-0a4d9fd19c8b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:28.102187 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e984b1a1-72e2-4b1b-ba4b-0a4d9fd19c8b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:28.110490 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e984b1a1-72e2-4b1b-ba4b-0a4d9fd19c8b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:28.110490 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e984b1a1-72e2-4b1b-ba4b-0a4d9fd19c8b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:28.110490 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e984b1a1-72e2-4b1b-ba4b-0a4d9fd19c8b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:28.110490 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e984b1a1-72e2-4b1b-ba4b-0a4d9fd19c8b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:28.231905 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-e984b1a1-72e2-4b1b-ba4b-0a4d9fd19c8b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:28.240355 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-e984b1a1-72e2-4b1b-ba4b-0a4d9fd19c8b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:28.241819 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-e984b1a1-72e2-4b1b-ba4b-0a4d9fd19c8b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:28.242917 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-e984b1a1-72e2-4b1b-ba4b-0a4d9fd19c8b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1406 microversion: 2.20 time: 0.151695 Aug 26 00:54:28.243471 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 53/107] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:54:28 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:54:28.548242 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-fed2b03a-d1e7-4d9b-be27-67504dfabcbd tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:28.549133 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-fed2b03a-d1e7-4d9b-be27-67504dfabcbd tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:28.555889 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fed2b03a-d1e7-4d9b-be27-67504dfabcbd tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:28.556382 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fed2b03a-d1e7-4d9b-be27-67504dfabcbd tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:28.556854 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fed2b03a-d1e7-4d9b-be27-67504dfabcbd tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:28.557545 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fed2b03a-d1e7-4d9b-be27-67504dfabcbd tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:28.557998 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fed2b03a-d1e7-4d9b-be27-67504dfabcbd tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:28.558419 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fed2b03a-d1e7-4d9b-be27-67504dfabcbd tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:28.692140 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-fed2b03a-d1e7-4d9b-be27-67504dfabcbd tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:28.699832 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-fed2b03a-d1e7-4d9b-be27-67504dfabcbd tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1322 microversion: 2.1 time: 0.155571 Aug 26 00:54:28.700398 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 55/108] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:28 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:54:28.849895 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-8e733d45-111d-4772-b36b-f8e0a354dc16 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:28.850620 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-8e733d45-111d-4772-b36b-f8e0a354dc16 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:28.859602 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8e733d45-111d-4772-b36b-f8e0a354dc16 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:28.865818 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8e733d45-111d-4772-b36b-f8e0a354dc16 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:28.865818 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8e733d45-111d-4772-b36b-f8e0a354dc16 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:28.865818 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8e733d45-111d-4772-b36b-f8e0a354dc16 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:28.865818 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8e733d45-111d-4772-b36b-f8e0a354dc16 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:28.866216 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8e733d45-111d-4772-b36b-f8e0a354dc16 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:29.015521 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-8e733d45-111d-4772-b36b-f8e0a354dc16 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:29.025743 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-8e733d45-111d-4772-b36b-f8e0a354dc16 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1362 microversion: 2.1 time: 0.180828 Aug 26 00:54:29.026302 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 54/109] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:28 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:29.080316 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-f5a03c33-c925-4387-a3da-77bba7478c8c tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:29.081029 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-f5a03c33-c925-4387-a3da-77bba7478c8c tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] [instance: d778c4bb-8dd8-4106-b7cc-12a1d485cf1e] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:29.087088 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f5a03c33-c925-4387-a3da-77bba7478c8c tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:29.087648 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f5a03c33-c925-4387-a3da-77bba7478c8c tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:29.088145 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f5a03c33-c925-4387-a3da-77bba7478c8c tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:29.088913 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f5a03c33-c925-4387-a3da-77bba7478c8c tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:29.089461 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f5a03c33-c925-4387-a3da-77bba7478c8c tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:29.089913 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f5a03c33-c925-4387-a3da-77bba7478c8c tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:29.225796 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-f5a03c33-c925-4387-a3da-77bba7478c8c tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a425027e59242bba6b05407d19cac82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032ed1b5aea842edb0bcae9d23810786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:29.233678 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-f5a03c33-c925-4387-a3da-77bba7478c8c tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] 10.222.0.59 "GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e" status: 200 len: 1314 microversion: 2.1 time: 0.157207 Aug 26 00:54:29.237875 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 56/110] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:29 2022] GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:29.265751 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-bcca30a8-92b0-4f90-b85f-af9233418546 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:29.266365 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-bcca30a8-92b0-4f90-b85f-af9233418546 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:29.272764 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-bcca30a8-92b0-4f90-b85f-af9233418546 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:29.273248 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-bcca30a8-92b0-4f90-b85f-af9233418546 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:29.273734 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-bcca30a8-92b0-4f90-b85f-af9233418546 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:29.274416 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-bcca30a8-92b0-4f90-b85f-af9233418546 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:29.274915 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-bcca30a8-92b0-4f90-b85f-af9233418546 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:29.275335 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-bcca30a8-92b0-4f90-b85f-af9233418546 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:29.408910 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-bcca30a8-92b0-4f90-b85f-af9233418546 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:29.417507 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-bcca30a8-92b0-4f90-b85f-af9233418546 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:29.428389 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-bcca30a8-92b0-4f90-b85f-af9233418546 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:29.428389 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-bcca30a8-92b0-4f90-b85f-af9233418546 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1406 microversion: 2.20 time: 0.158138 Aug 26 00:54:29.428389 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 55/111] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:54:29 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:54:29.720087 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-533570b5-e718-41c7-8081-36f8231df70f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:29.720730 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-533570b5-e718-41c7-8081-36f8231df70f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:29.727571 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-533570b5-e718-41c7-8081-36f8231df70f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:29.732002 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-533570b5-e718-41c7-8081-36f8231df70f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:29.732002 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-533570b5-e718-41c7-8081-36f8231df70f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:29.732002 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-533570b5-e718-41c7-8081-36f8231df70f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:29.732002 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-533570b5-e718-41c7-8081-36f8231df70f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:29.732370 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-533570b5-e718-41c7-8081-36f8231df70f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:29.859396 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-533570b5-e718-41c7-8081-36f8231df70f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:29.867826 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-533570b5-e718-41c7-8081-36f8231df70f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1322 microversion: 2.1 time: 0.151328 Aug 26 00:54:29.868285 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 57/112] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:29 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:30.047840 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-ca23a9ab-3bad-45a3-afe0-f3f473ea6a53 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:30.048592 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-ca23a9ab-3bad-45a3-afe0-f3f473ea6a53 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:30.055762 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ca23a9ab-3bad-45a3-afe0-f3f473ea6a53 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:30.056313 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ca23a9ab-3bad-45a3-afe0-f3f473ea6a53 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:30.056833 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ca23a9ab-3bad-45a3-afe0-f3f473ea6a53 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:30.057586 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ca23a9ab-3bad-45a3-afe0-f3f473ea6a53 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:30.058099 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ca23a9ab-3bad-45a3-afe0-f3f473ea6a53 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:30.058583 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ca23a9ab-3bad-45a3-afe0-f3f473ea6a53 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:30.198519 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-ca23a9ab-3bad-45a3-afe0-f3f473ea6a53 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:30.206190 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-ca23a9ab-3bad-45a3-afe0-f3f473ea6a53 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1362 microversion: 2.1 time: 0.162965 Aug 26 00:54:30.206748 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 56/113] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:30 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:30.256907 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-00e40691-4d3f-4644-b081-bc201c7f20cc tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:30.257479 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-00e40691-4d3f-4644-b081-bc201c7f20cc tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] [instance: d778c4bb-8dd8-4106-b7cc-12a1d485cf1e] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:30.263300 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-00e40691-4d3f-4644-b081-bc201c7f20cc tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:30.263782 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-00e40691-4d3f-4644-b081-bc201c7f20cc tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:30.264213 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-00e40691-4d3f-4644-b081-bc201c7f20cc tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:30.264922 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-00e40691-4d3f-4644-b081-bc201c7f20cc tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:30.265368 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-00e40691-4d3f-4644-b081-bc201c7f20cc tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:30.265785 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-00e40691-4d3f-4644-b081-bc201c7f20cc tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:30.397444 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-00e40691-4d3f-4644-b081-bc201c7f20cc tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a425027e59242bba6b05407d19cac82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032ed1b5aea842edb0bcae9d23810786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:30.406373 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-00e40691-4d3f-4644-b081-bc201c7f20cc tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] 10.222.0.59 "GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e" status: 200 len: 1314 microversion: 2.1 time: 0.153147 Aug 26 00:54:30.406951 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 58/114] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:30 2022] GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:30.442578 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-dfe63cd2-f53b-4fd4-b936-2d0d894e68a8 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:30.443223 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-dfe63cd2-f53b-4fd4-b936-2d0d894e68a8 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:30.449666 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-dfe63cd2-f53b-4fd4-b936-2d0d894e68a8 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:30.450192 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-dfe63cd2-f53b-4fd4-b936-2d0d894e68a8 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:30.450622 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-dfe63cd2-f53b-4fd4-b936-2d0d894e68a8 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:30.451307 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-dfe63cd2-f53b-4fd4-b936-2d0d894e68a8 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:30.451980 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-dfe63cd2-f53b-4fd4-b936-2d0d894e68a8 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:30.452395 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-dfe63cd2-f53b-4fd4-b936-2d0d894e68a8 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:30.603289 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-dfe63cd2-f53b-4fd4-b936-2d0d894e68a8 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:30.611640 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-dfe63cd2-f53b-4fd4-b936-2d0d894e68a8 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:30.613148 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-dfe63cd2-f53b-4fd4-b936-2d0d894e68a8 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:30.618262 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-dfe63cd2-f53b-4fd4-b936-2d0d894e68a8 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1406 microversion: 2.20 time: 0.176908 Aug 26 00:54:30.631393 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 57/115] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:54:30 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1406 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:54:30.889169 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-31ba3a09-9ee8-4e81-a8f2-d24f3c82963c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:30.889783 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-31ba3a09-9ee8-4e81-a8f2-d24f3c82963c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:30.895745 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-31ba3a09-9ee8-4e81-a8f2-d24f3c82963c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:30.896230 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-31ba3a09-9ee8-4e81-a8f2-d24f3c82963c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:30.896888 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-31ba3a09-9ee8-4e81-a8f2-d24f3c82963c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:30.897584 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-31ba3a09-9ee8-4e81-a8f2-d24f3c82963c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:30.898036 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-31ba3a09-9ee8-4e81-a8f2-d24f3c82963c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:30.898461 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-31ba3a09-9ee8-4e81-a8f2-d24f3c82963c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:31.040859 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-31ba3a09-9ee8-4e81-a8f2-d24f3c82963c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:31.051827 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-31ba3a09-9ee8-4e81-a8f2-d24f3c82963c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1322 microversion: 2.1 time: 0.165260 Aug 26 00:54:31.052055 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 59/116] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:30 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:31.226757 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-d446f5bb-3c49-4c2c-9898-ec664593a73f tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:31.227356 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-d446f5bb-3c49-4c2c-9898-ec664593a73f tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:31.233290 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d446f5bb-3c49-4c2c-9898-ec664593a73f tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:31.233765 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d446f5bb-3c49-4c2c-9898-ec664593a73f tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:31.234194 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d446f5bb-3c49-4c2c-9898-ec664593a73f tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:31.234864 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d446f5bb-3c49-4c2c-9898-ec664593a73f tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:31.235333 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d446f5bb-3c49-4c2c-9898-ec664593a73f tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:31.235742 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d446f5bb-3c49-4c2c-9898-ec664593a73f tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:31.409754 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-d446f5bb-3c49-4c2c-9898-ec664593a73f tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:31.419006 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-d446f5bb-3c49-4c2c-9898-ec664593a73f tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1362 microversion: 2.1 time: 0.196108 Aug 26 00:54:31.419836 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 58/117] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:31 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1362 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:31.439603 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-63cc572c-e30b-44c1-8ccc-eb9ad5a2cbe3 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:31.441694 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-63cc572c-e30b-44c1-8ccc-eb9ad5a2cbe3 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] [instance: d778c4bb-8dd8-4106-b7cc-12a1d485cf1e] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:31.446818 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-63cc572c-e30b-44c1-8ccc-eb9ad5a2cbe3 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:31.447306 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-63cc572c-e30b-44c1-8ccc-eb9ad5a2cbe3 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:31.447731 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-63cc572c-e30b-44c1-8ccc-eb9ad5a2cbe3 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:31.448406 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-63cc572c-e30b-44c1-8ccc-eb9ad5a2cbe3 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:31.448877 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-63cc572c-e30b-44c1-8ccc-eb9ad5a2cbe3 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:31.449289 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-63cc572c-e30b-44c1-8ccc-eb9ad5a2cbe3 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:31.581560 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-63cc572c-e30b-44c1-8ccc-eb9ad5a2cbe3 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a425027e59242bba6b05407d19cac82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032ed1b5aea842edb0bcae9d23810786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:31.589892 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-63cc572c-e30b-44c1-8ccc-eb9ad5a2cbe3 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] 10.222.0.59 "GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e" status: 200 len: 1314 microversion: 2.1 time: 0.156011 Aug 26 00:54:31.590471 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 60/118] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:31 2022] GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:31.637866 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-c8b968ef-ed93-4cd0-80c1-3d499d3045a7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:31.638561 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-c8b968ef-ed93-4cd0-80c1-3d499d3045a7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:31.644590 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c8b968ef-ed93-4cd0-80c1-3d499d3045a7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:31.645675 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c8b968ef-ed93-4cd0-80c1-3d499d3045a7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:31.646106 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c8b968ef-ed93-4cd0-80c1-3d499d3045a7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:31.646779 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c8b968ef-ed93-4cd0-80c1-3d499d3045a7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:31.647221 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c8b968ef-ed93-4cd0-80c1-3d499d3045a7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:31.647635 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c8b968ef-ed93-4cd0-80c1-3d499d3045a7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:31.773839 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-c8b968ef-ed93-4cd0-80c1-3d499d3045a7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:31.782255 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-c8b968ef-ed93-4cd0-80c1-3d499d3045a7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:31.784268 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-c8b968ef-ed93-4cd0-80c1-3d499d3045a7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:31.789297 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-c8b968ef-ed93-4cd0-80c1-3d499d3045a7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1406 microversion: 2.20 time: 0.155205 Aug 26 00:54:31.790391 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 59/119] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:54:31 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:54:32.071708 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-796afe4a-aa86-4b0b-84e4-9f239ee49f6a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:32.072311 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-796afe4a-aa86-4b0b-84e4-9f239ee49f6a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:32.078994 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-796afe4a-aa86-4b0b-84e4-9f239ee49f6a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:32.079927 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-796afe4a-aa86-4b0b-84e4-9f239ee49f6a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:32.080615 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-796afe4a-aa86-4b0b-84e4-9f239ee49f6a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:32.081345 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-796afe4a-aa86-4b0b-84e4-9f239ee49f6a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:32.081795 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-796afe4a-aa86-4b0b-84e4-9f239ee49f6a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:32.082235 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-796afe4a-aa86-4b0b-84e4-9f239ee49f6a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:32.272777 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-796afe4a-aa86-4b0b-84e4-9f239ee49f6a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:32.281785 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-796afe4a-aa86-4b0b-84e4-9f239ee49f6a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1322 microversion: 2.1 time: 0.213837 Aug 26 00:54:32.282440 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 61/120] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:32 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:32.455977 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-55159e50-7f73-4a89-9420-a77e47121b49 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:32.455977 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-55159e50-7f73-4a89-9420-a77e47121b49 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:32.457712 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-55159e50-7f73-4a89-9420-a77e47121b49 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:32.458604 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-55159e50-7f73-4a89-9420-a77e47121b49 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:32.459394 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-55159e50-7f73-4a89-9420-a77e47121b49 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:32.460671 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-55159e50-7f73-4a89-9420-a77e47121b49 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:32.461504 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-55159e50-7f73-4a89-9420-a77e47121b49 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:32.462285 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-55159e50-7f73-4a89-9420-a77e47121b49 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:32.617074 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-c6e537cd-cbc3-4899-a18b-7ad76cc0bd6a tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:32.617074 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-c6e537cd-cbc3-4899-a18b-7ad76cc0bd6a tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] [instance: d778c4bb-8dd8-4106-b7cc-12a1d485cf1e] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:32.618228 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c6e537cd-cbc3-4899-a18b-7ad76cc0bd6a tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:32.618725 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c6e537cd-cbc3-4899-a18b-7ad76cc0bd6a tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:32.624574 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c6e537cd-cbc3-4899-a18b-7ad76cc0bd6a tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:32.624574 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c6e537cd-cbc3-4899-a18b-7ad76cc0bd6a tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:32.624574 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c6e537cd-cbc3-4899-a18b-7ad76cc0bd6a tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:32.624574 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c6e537cd-cbc3-4899-a18b-7ad76cc0bd6a tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:32.676323 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-55159e50-7f73-4a89-9420-a77e47121b49 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:32.684373 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-55159e50-7f73-4a89-9420-a77e47121b49 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1362 microversion: 2.1 time: 0.246264 Aug 26 00:54:32.684977 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 60/121] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:32 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1362 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:32.774765 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-c6e537cd-cbc3-4899-a18b-7ad76cc0bd6a tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a425027e59242bba6b05407d19cac82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032ed1b5aea842edb0bcae9d23810786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:32.783412 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-c6e537cd-cbc3-4899-a18b-7ad76cc0bd6a tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] 10.222.0.59 "GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e" status: 200 len: 1314 microversion: 2.1 time: 0.176553 Aug 26 00:54:32.786416 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 62/122] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:32 2022] GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:54:32.815820 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-69586b7d-b349-4a44-8955-6174f2d08306 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:32.816729 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-69586b7d-b349-4a44-8955-6174f2d08306 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:32.823191 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-69586b7d-b349-4a44-8955-6174f2d08306 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:32.823667 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-69586b7d-b349-4a44-8955-6174f2d08306 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:32.824098 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-69586b7d-b349-4a44-8955-6174f2d08306 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:32.824893 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-69586b7d-b349-4a44-8955-6174f2d08306 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:32.825332 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-69586b7d-b349-4a44-8955-6174f2d08306 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:32.825748 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-69586b7d-b349-4a44-8955-6174f2d08306 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:33.016705 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-69586b7d-b349-4a44-8955-6174f2d08306 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:33.033084 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-69586b7d-b349-4a44-8955-6174f2d08306 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:33.033084 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-69586b7d-b349-4a44-8955-6174f2d08306 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:33.034596 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-69586b7d-b349-4a44-8955-6174f2d08306 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1406 microversion: 2.20 time: 0.224755 Aug 26 00:54:33.036824 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 61/123] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:54:32 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1406 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:54:33.147383 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [req-638642c5-08ae-49ea-b2bc-af94aa5bcda9 req-32d754f9-13b3-40d0-bc7a-c27900bdcdf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be", "name": "network-vif-plugged", "status": "completed", "tag": "833db4f2-eca1-40db-a1e7-c07312b7e9d1"}]} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:54:33.151716 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-638642c5-08ae-49ea-b2bc-af94aa5bcda9 req-32d754f9-13b3-40d0-bc7a-c27900bdcdf9 service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:33.152180 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-638642c5-08ae-49ea-b2bc-af94aa5bcda9 req-32d754f9-13b3-40d0-bc7a-c27900bdcdf9 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:33.152634 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-638642c5-08ae-49ea-b2bc-af94aa5bcda9 req-32d754f9-13b3-40d0-bc7a-c27900bdcdf9 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:33.163777 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.compute.server_external_events [req-638642c5-08ae-49ea-b2bc-af94aa5bcda9 req-32d754f9-13b3-40d0-bc7a-c27900bdcdf9 service nova] Creating event network-vif-plugged:833db4f2-eca1-40db-a1e7-c07312b7e9d1 for instance 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be on hv-cinder-83538 Aug 26 00:54:33.168906 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [req-638642c5-08ae-49ea-b2bc-af94aa5bcda9 req-32d754f9-13b3-40d0-bc7a-c27900bdcdf9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087439 Aug 26 00:54:33.169497 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 63/124] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 00:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:54:33.311145 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-6be9a734-ab38-40b5-8976-01961a733943 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:33.311145 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-6be9a734-ab38-40b5-8976-01961a733943 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:33.316353 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6be9a734-ab38-40b5-8976-01961a733943 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:33.316853 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6be9a734-ab38-40b5-8976-01961a733943 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:33.317705 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6be9a734-ab38-40b5-8976-01961a733943 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:33.318418 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6be9a734-ab38-40b5-8976-01961a733943 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:33.318878 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6be9a734-ab38-40b5-8976-01961a733943 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:33.319322 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6be9a734-ab38-40b5-8976-01961a733943 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:33.483331 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-6be9a734-ab38-40b5-8976-01961a733943 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:33.492017 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-6be9a734-ab38-40b5-8976-01961a733943 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1322 microversion: 2.1 time: 0.191440 Aug 26 00:54:33.492618 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 62/125] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:33 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1322 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:33.706626 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-750fd4e8-02eb-457a-8158-43a99806a53a tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:33.707356 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-750fd4e8-02eb-457a-8158-43a99806a53a tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:33.716273 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-750fd4e8-02eb-457a-8158-43a99806a53a tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:33.716818 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-750fd4e8-02eb-457a-8158-43a99806a53a tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:33.717255 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-750fd4e8-02eb-457a-8158-43a99806a53a tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:33.717947 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-750fd4e8-02eb-457a-8158-43a99806a53a tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:33.718392 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-750fd4e8-02eb-457a-8158-43a99806a53a tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:33.724076 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-750fd4e8-02eb-457a-8158-43a99806a53a tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:33.812787 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-1d26a183-5bc6-4789-8184-527381f5c54e tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:33.814264 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-1d26a183-5bc6-4789-8184-527381f5c54e tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] [instance: d778c4bb-8dd8-4106-b7cc-12a1d485cf1e] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:33.828878 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1d26a183-5bc6-4789-8184-527381f5c54e tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:33.829362 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1d26a183-5bc6-4789-8184-527381f5c54e tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:33.829807 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1d26a183-5bc6-4789-8184-527381f5c54e tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:33.830509 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1d26a183-5bc6-4789-8184-527381f5c54e tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:33.830949 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1d26a183-5bc6-4789-8184-527381f5c54e tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:33.831361 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1d26a183-5bc6-4789-8184-527381f5c54e tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:33.878057 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-750fd4e8-02eb-457a-8158-43a99806a53a tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:33.887124 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-750fd4e8-02eb-457a-8158-43a99806a53a tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1362 microversion: 2.1 time: 0.185448 Aug 26 00:54:33.887706 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 64/126] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:33 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1362 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:33.984527 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-1d26a183-5bc6-4789-8184-527381f5c54e tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a425027e59242bba6b05407d19cac82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032ed1b5aea842edb0bcae9d23810786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:33.993953 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-1d26a183-5bc6-4789-8184-527381f5c54e tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] 10.222.0.59 "GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e" status: 200 len: 1314 microversion: 2.1 time: 0.189988 Aug 26 00:54:33.994539 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 63/127] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:33 2022] GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:34.061933 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-c8cea2ee-2038-4e7b-9073-fec1f92241c2 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:34.062891 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-c8cea2ee-2038-4e7b-9073-fec1f92241c2 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:34.069003 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c8cea2ee-2038-4e7b-9073-fec1f92241c2 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:34.069488 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c8cea2ee-2038-4e7b-9073-fec1f92241c2 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:34.069973 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c8cea2ee-2038-4e7b-9073-fec1f92241c2 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:34.070663 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c8cea2ee-2038-4e7b-9073-fec1f92241c2 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:34.071116 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c8cea2ee-2038-4e7b-9073-fec1f92241c2 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:34.071538 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c8cea2ee-2038-4e7b-9073-fec1f92241c2 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:34.205483 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-c8cea2ee-2038-4e7b-9073-fec1f92241c2 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:34.214381 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-c8cea2ee-2038-4e7b-9073-fec1f92241c2 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:34.215807 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-c8cea2ee-2038-4e7b-9073-fec1f92241c2 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:34.216944 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-c8cea2ee-2038-4e7b-9073-fec1f92241c2 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1406 microversion: 2.20 time: 0.158914 Aug 26 00:54:34.217827 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 65/128] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:54:34 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:54:34.513438 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-49444019-2cf3-4bf7-9294-7e80feb4a3ee tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:34.514048 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-49444019-2cf3-4bf7-9294-7e80feb4a3ee tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:34.520698 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-49444019-2cf3-4bf7-9294-7e80feb4a3ee tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:34.521185 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-49444019-2cf3-4bf7-9294-7e80feb4a3ee tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:34.521615 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-49444019-2cf3-4bf7-9294-7e80feb4a3ee tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:34.522298 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-49444019-2cf3-4bf7-9294-7e80feb4a3ee tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:34.522745 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-49444019-2cf3-4bf7-9294-7e80feb4a3ee tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:34.523195 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-49444019-2cf3-4bf7-9294-7e80feb4a3ee tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:34.665748 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-49444019-2cf3-4bf7-9294-7e80feb4a3ee tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:34.673570 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-49444019-2cf3-4bf7-9294-7e80feb4a3ee tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1322 microversion: 2.1 time: 0.163982 Aug 26 00:54:34.674140 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 64/129] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:34 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:34.909772 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-76b33546-b530-4302-850d-0d6eee552053 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:34.909772 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-76b33546-b530-4302-850d-0d6eee552053 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:34.915469 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-76b33546-b530-4302-850d-0d6eee552053 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:34.915952 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-76b33546-b530-4302-850d-0d6eee552053 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:34.916385 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-76b33546-b530-4302-850d-0d6eee552053 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:34.917096 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-76b33546-b530-4302-850d-0d6eee552053 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:34.917544 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-76b33546-b530-4302-850d-0d6eee552053 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:34.917970 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-76b33546-b530-4302-850d-0d6eee552053 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:35.013820 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-db28cbda-70e7-4e1b-981f-0459889b88c8 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:35.014417 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-db28cbda-70e7-4e1b-981f-0459889b88c8 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] [instance: d778c4bb-8dd8-4106-b7cc-12a1d485cf1e] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:35.020415 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-db28cbda-70e7-4e1b-981f-0459889b88c8 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:35.020919 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-db28cbda-70e7-4e1b-981f-0459889b88c8 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:35.021343 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-db28cbda-70e7-4e1b-981f-0459889b88c8 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:35.022015 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-db28cbda-70e7-4e1b-981f-0459889b88c8 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:35.022456 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-db28cbda-70e7-4e1b-981f-0459889b88c8 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:35.023172 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-db28cbda-70e7-4e1b-981f-0459889b88c8 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:35.048056 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-76b33546-b530-4302-850d-0d6eee552053 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:35.056830 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-76b33546-b530-4302-850d-0d6eee552053 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1362 microversion: 2.1 time: 0.152373 Aug 26 00:54:35.057788 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 66/130] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:34 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:35.151759 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-db28cbda-70e7-4e1b-981f-0459889b88c8 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a425027e59242bba6b05407d19cac82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032ed1b5aea842edb0bcae9d23810786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:35.159385 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-db28cbda-70e7-4e1b-981f-0459889b88c8 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] 10.222.0.59 "GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e" status: 200 len: 1314 microversion: 2.1 time: 0.149410 Aug 26 00:54:35.159995 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 65/131] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:35 2022] GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:54:35.184194 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [req-f308d2e0-95e6-4b93-b775-c9431dcfbea2 req-5c146bd6-db95-473b-880f-2344b7997744 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d778c4bb-8dd8-4106-b7cc-12a1d485cf1e", "name": "network-vif-plugged", "status": "completed", "tag": "5f1c5b36-2ace-4432-8c74-20a3b6c61298"}, {"server_uuid": "3079fdb4-9b6d-4030-a7ce-bdf5bff324ab", "name": "network-vif-plugged", "status": "completed", "tag": "370c2a59-a26b-4a3e-8768-1300357aad68"}]} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:54:35.194863 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-f308d2e0-95e6-4b93-b775-c9431dcfbea2 req-5c146bd6-db95-473b-880f-2344b7997744 service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:35.195334 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-f308d2e0-95e6-4b93-b775-c9431dcfbea2 req-5c146bd6-db95-473b-880f-2344b7997744 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:35.195761 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-f308d2e0-95e6-4b93-b775-c9431dcfbea2 req-5c146bd6-db95-473b-880f-2344b7997744 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:35.208080 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.compute.server_external_events [req-f308d2e0-95e6-4b93-b775-c9431dcfbea2 req-5c146bd6-db95-473b-880f-2344b7997744 service nova] Creating event network-vif-plugged:5f1c5b36-2ace-4432-8c74-20a3b6c61298 for instance d778c4bb-8dd8-4106-b7cc-12a1d485cf1e on hv-cinder-83538 Aug 26 00:54:35.208677 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.compute.server_external_events [req-f308d2e0-95e6-4b93-b775-c9431dcfbea2 req-5c146bd6-db95-473b-880f-2344b7997744 service nova] Creating event network-vif-plugged:370c2a59-a26b-4a3e-8768-1300357aad68 for instance 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab on hv-cinder-83538 Aug 26 00:54:35.215172 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [req-f308d2e0-95e6-4b93-b775-c9431dcfbea2 req-5c146bd6-db95-473b-880f-2344b7997744 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034658 Aug 26 00:54:35.215770 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 67/132] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 00:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:54:35.240653 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-6ba6b9a4-b887-4859-9222-d3afc716ca98 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:35.241398 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-6ba6b9a4-b887-4859-9222-d3afc716ca98 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:35.247322 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6ba6b9a4-b887-4859-9222-d3afc716ca98 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:35.247803 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6ba6b9a4-b887-4859-9222-d3afc716ca98 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:35.248252 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6ba6b9a4-b887-4859-9222-d3afc716ca98 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:35.248938 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6ba6b9a4-b887-4859-9222-d3afc716ca98 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:35.249385 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6ba6b9a4-b887-4859-9222-d3afc716ca98 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:35.249808 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6ba6b9a4-b887-4859-9222-d3afc716ca98 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:35.382850 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-6ba6b9a4-b887-4859-9222-d3afc716ca98 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:35.390955 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-6ba6b9a4-b887-4859-9222-d3afc716ca98 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:35.392403 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-6ba6b9a4-b887-4859-9222-d3afc716ca98 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:35.393514 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-6ba6b9a4-b887-4859-9222-d3afc716ca98 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1406 microversion: 2.20 time: 0.157305 Aug 26 00:54:35.394071 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 66/133] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:54:35 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:54:35.695945 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-8eecbbeb-2c2d-47c6-ba1a-5bce091c15d2 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:35.696887 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-8eecbbeb-2c2d-47c6-ba1a-5bce091c15d2 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:35.703485 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8eecbbeb-2c2d-47c6-ba1a-5bce091c15d2 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:35.704051 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8eecbbeb-2c2d-47c6-ba1a-5bce091c15d2 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:35.704594 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8eecbbeb-2c2d-47c6-ba1a-5bce091c15d2 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:35.705365 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8eecbbeb-2c2d-47c6-ba1a-5bce091c15d2 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:35.706020 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8eecbbeb-2c2d-47c6-ba1a-5bce091c15d2 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:35.706450 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8eecbbeb-2c2d-47c6-ba1a-5bce091c15d2 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:35.878225 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-8eecbbeb-2c2d-47c6-ba1a-5bce091c15d2 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:35.881807 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell1:SELECT=100 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:54:35.887076 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-8eecbbeb-2c2d-47c6-ba1a-5bce091c15d2 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1322 microversion: 2.1 time: 0.196509 Aug 26 00:54:35.887647 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 68/134] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:35 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1322 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:36.077394 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-3832090e-7462-4be4-9da8-66e177e73b51 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:36.078619 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-3832090e-7462-4be4-9da8-66e177e73b51 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:36.085351 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3832090e-7462-4be4-9da8-66e177e73b51 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:36.085842 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3832090e-7462-4be4-9da8-66e177e73b51 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:36.086265 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3832090e-7462-4be4-9da8-66e177e73b51 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:36.089455 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3832090e-7462-4be4-9da8-66e177e73b51 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:36.089455 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3832090e-7462-4be4-9da8-66e177e73b51 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:36.089455 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3832090e-7462-4be4-9da8-66e177e73b51 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:36.186151 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-1f09b633-3cbd-4c3d-b281-d72b57ad6e17 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:36.186760 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-1f09b633-3cbd-4c3d-b281-d72b57ad6e17 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] [instance: d778c4bb-8dd8-4106-b7cc-12a1d485cf1e] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:36.194432 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1f09b633-3cbd-4c3d-b281-d72b57ad6e17 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:36.202808 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1f09b633-3cbd-4c3d-b281-d72b57ad6e17 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:36.203267 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1f09b633-3cbd-4c3d-b281-d72b57ad6e17 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:36.204767 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1f09b633-3cbd-4c3d-b281-d72b57ad6e17 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:36.205522 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1f09b633-3cbd-4c3d-b281-d72b57ad6e17 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:36.210934 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1f09b633-3cbd-4c3d-b281-d72b57ad6e17 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:36.368587 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-3832090e-7462-4be4-9da8-66e177e73b51 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:36.376892 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-3832090e-7462-4be4-9da8-66e177e73b51 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1362 microversion: 2.1 time: 0.303132 Aug 26 00:54:36.378289 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 67/135] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:36 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1362 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:36.418756 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-9f342e60-cb1a-4c04-a6e7-d81e0bef9240 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:36.420351 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-9f342e60-cb1a-4c04-a6e7-d81e0bef9240 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:36.427413 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9f342e60-cb1a-4c04-a6e7-d81e0bef9240 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:36.428288 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9f342e60-cb1a-4c04-a6e7-d81e0bef9240 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:36.428923 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9f342e60-cb1a-4c04-a6e7-d81e0bef9240 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:36.429844 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9f342e60-cb1a-4c04-a6e7-d81e0bef9240 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:36.430443 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9f342e60-cb1a-4c04-a6e7-d81e0bef9240 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:36.431016 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9f342e60-cb1a-4c04-a6e7-d81e0bef9240 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:36.450363 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell1:SELECT=100 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:54:36.690529 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-1f09b633-3cbd-4c3d-b281-d72b57ad6e17 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a425027e59242bba6b05407d19cac82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032ed1b5aea842edb0bcae9d23810786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:36.692615 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-9f342e60-cb1a-4c04-a6e7-d81e0bef9240 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:36.699231 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-1f09b633-3cbd-4c3d-b281-d72b57ad6e17 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] 10.222.0.59 "GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e" status: 200 len: 1314 microversion: 2.1 time: 0.517730 Aug 26 00:54:36.700141 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 69/136] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:36 2022] GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e => generated 1314 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:54:36.702040 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-9f342e60-cb1a-4c04-a6e7-d81e0bef9240 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:36.703549 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-9f342e60-cb1a-4c04-a6e7-d81e0bef9240 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:36.708021 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-9f342e60-cb1a-4c04-a6e7-d81e0bef9240 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1406 microversion: 2.20 time: 0.293658 Aug 26 00:54:36.710612 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 68/137] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:54:36 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1406 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 00:54:36.908354 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-15652f28-41eb-4d4e-8bad-b2d11cd4620c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:36.908992 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-15652f28-41eb-4d4e-8bad-b2d11cd4620c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:36.915343 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-15652f28-41eb-4d4e-8bad-b2d11cd4620c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:36.915852 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-15652f28-41eb-4d4e-8bad-b2d11cd4620c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:36.916287 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-15652f28-41eb-4d4e-8bad-b2d11cd4620c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:36.917020 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-15652f28-41eb-4d4e-8bad-b2d11cd4620c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:36.917466 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-15652f28-41eb-4d4e-8bad-b2d11cd4620c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:36.917882 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-15652f28-41eb-4d4e-8bad-b2d11cd4620c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:37.070504 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-15652f28-41eb-4d4e-8bad-b2d11cd4620c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:37.080502 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-15652f28-41eb-4d4e-8bad-b2d11cd4620c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1322 microversion: 2.1 time: 0.175872 Aug 26 00:54:37.085983 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 70/138] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:36 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:37.400989 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-c09b7920-7ef7-43f5-a146-8400dd9ba8bd tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:37.400989 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-c09b7920-7ef7-43f5-a146-8400dd9ba8bd tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:37.406336 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c09b7920-7ef7-43f5-a146-8400dd9ba8bd tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:37.408232 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c09b7920-7ef7-43f5-a146-8400dd9ba8bd tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:37.408666 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c09b7920-7ef7-43f5-a146-8400dd9ba8bd tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:37.409379 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c09b7920-7ef7-43f5-a146-8400dd9ba8bd tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:37.409837 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c09b7920-7ef7-43f5-a146-8400dd9ba8bd tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:37.410293 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c09b7920-7ef7-43f5-a146-8400dd9ba8bd tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:37.619513 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-c09b7920-7ef7-43f5-a146-8400dd9ba8bd tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:37.628145 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-c09b7920-7ef7-43f5-a146-8400dd9ba8bd tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1362 microversion: 2.1 time: 0.232700 Aug 26 00:54:37.629583 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 69/139] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:37 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1362 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:37.720432 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-86536f96-7a3e-4450-9449-178e79a44adc tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:37.721226 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-86536f96-7a3e-4450-9449-178e79a44adc tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] [instance: d778c4bb-8dd8-4106-b7cc-12a1d485cf1e] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:37.727705 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-86536f96-7a3e-4450-9449-178e79a44adc tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:37.728349 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-86536f96-7a3e-4450-9449-178e79a44adc tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:37.728972 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-86536f96-7a3e-4450-9449-178e79a44adc tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:37.732981 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-86536f96-7a3e-4450-9449-178e79a44adc tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:37.733739 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-86536f96-7a3e-4450-9449-178e79a44adc tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:37.734615 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-86536f96-7a3e-4450-9449-178e79a44adc tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:37.738758 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-bb0dce69-d07f-4209-ba4a-846cf106b0dd tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:37.739448 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-bb0dce69-d07f-4209-ba4a-846cf106b0dd tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:37.758980 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-bb0dce69-d07f-4209-ba4a-846cf106b0dd tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:37.759472 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-bb0dce69-d07f-4209-ba4a-846cf106b0dd tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:37.760054 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-bb0dce69-d07f-4209-ba4a-846cf106b0dd tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:37.760788 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-bb0dce69-d07f-4209-ba4a-846cf106b0dd tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:37.761244 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-bb0dce69-d07f-4209-ba4a-846cf106b0dd tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:37.761662 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-bb0dce69-d07f-4209-ba4a-846cf106b0dd tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:37.887478 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-86536f96-7a3e-4450-9449-178e79a44adc tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a425027e59242bba6b05407d19cac82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032ed1b5aea842edb0bcae9d23810786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:37.896054 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-86536f96-7a3e-4450-9449-178e79a44adc tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] 10.222.0.59 "GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e" status: 200 len: 1314 microversion: 2.1 time: 0.179995 Aug 26 00:54:37.900517 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 71/140] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:37 2022] GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:37.966457 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-bb0dce69-d07f-4209-ba4a-846cf106b0dd tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:37.975989 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-bb0dce69-d07f-4209-ba4a-846cf106b0dd tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:37.977927 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-bb0dce69-d07f-4209-ba4a-846cf106b0dd tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:37.979059 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-bb0dce69-d07f-4209-ba4a-846cf106b0dd tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1406 microversion: 2.20 time: 0.248422 Aug 26 00:54:37.995570 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 70/141] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:54:37 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1406 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 00:54:38.101890 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-42398930-791d-4f56-b3a8-39b7bc637448 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:38.102805 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-42398930-791d-4f56-b3a8-39b7bc637448 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:38.115840 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-42398930-791d-4f56-b3a8-39b7bc637448 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:38.116561 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-42398930-791d-4f56-b3a8-39b7bc637448 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:38.117390 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-42398930-791d-4f56-b3a8-39b7bc637448 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:38.118688 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-42398930-791d-4f56-b3a8-39b7bc637448 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:38.119319 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-42398930-791d-4f56-b3a8-39b7bc637448 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:38.119878 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-42398930-791d-4f56-b3a8-39b7bc637448 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:38.265230 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-42398930-791d-4f56-b3a8-39b7bc637448 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:38.273678 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-42398930-791d-4f56-b3a8-39b7bc637448 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1322 microversion: 2.1 time: 0.175644 Aug 26 00:54:38.283692 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 72/142] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:38 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:38.325312 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [req-2f0e60e7-2029-4150-a2cb-4a09059c8811 req-d6bf54b8-8995-4c1d-b019-c2222212d937 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "730816fc-0c43-43e3-ab6e-e7f324e403d7", "name": "network-vif-plugged", "status": "completed", "tag": "9a9a5c66-fe0c-40d8-ae1a-65494e24310f"}]} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:54:38.336128 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-2f0e60e7-2029-4150-a2cb-4a09059c8811 req-d6bf54b8-8995-4c1d-b019-c2222212d937 service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:38.336735 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-2f0e60e7-2029-4150-a2cb-4a09059c8811 req-d6bf54b8-8995-4c1d-b019-c2222212d937 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:38.337331 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-2f0e60e7-2029-4150-a2cb-4a09059c8811 req-d6bf54b8-8995-4c1d-b019-c2222212d937 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:38.348905 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.compute.server_external_events [req-2f0e60e7-2029-4150-a2cb-4a09059c8811 req-d6bf54b8-8995-4c1d-b019-c2222212d937 service nova] Creating event network-vif-plugged:9a9a5c66-fe0c-40d8-ae1a-65494e24310f for instance 730816fc-0c43-43e3-ab6e-e7f324e403d7 on hv-cinder-83538 Aug 26 00:54:38.354134 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [req-2f0e60e7-2029-4150-a2cb-4a09059c8811 req-d6bf54b8-8995-4c1d-b019-c2222212d937 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033403 Aug 26 00:54:38.355051 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 71/143] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 00:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:54:38.649112 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-bb56d37f-3c07-40b7-bf54-4394aeb86111 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:38.649888 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-bb56d37f-3c07-40b7-bf54-4394aeb86111 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:38.655942 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bb56d37f-3c07-40b7-bf54-4394aeb86111 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:38.656418 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bb56d37f-3c07-40b7-bf54-4394aeb86111 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:38.656877 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bb56d37f-3c07-40b7-bf54-4394aeb86111 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:38.657560 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bb56d37f-3c07-40b7-bf54-4394aeb86111 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:38.658009 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bb56d37f-3c07-40b7-bf54-4394aeb86111 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:38.658428 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bb56d37f-3c07-40b7-bf54-4394aeb86111 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:38.799263 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-bb56d37f-3c07-40b7-bf54-4394aeb86111 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:38.814036 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-bb56d37f-3c07-40b7-bf54-4394aeb86111 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1362 microversion: 2.1 time: 0.168817 Aug 26 00:54:38.814680 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 73/144] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:38 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:38.918619 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-4a429509-f654-4001-b7df-c4b0d697e362 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:38.919925 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-4a429509-f654-4001-b7df-c4b0d697e362 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] [instance: d778c4bb-8dd8-4106-b7cc-12a1d485cf1e] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:38.927011 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4a429509-f654-4001-b7df-c4b0d697e362 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:38.927503 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4a429509-f654-4001-b7df-c4b0d697e362 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:38.927945 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4a429509-f654-4001-b7df-c4b0d697e362 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:38.930630 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4a429509-f654-4001-b7df-c4b0d697e362 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:38.930630 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4a429509-f654-4001-b7df-c4b0d697e362 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:38.930630 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4a429509-f654-4001-b7df-c4b0d697e362 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:39.002440 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-629dde4e-0d69-4942-8833-e2e9ebf6dace tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:39.003056 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-629dde4e-0d69-4942-8833-e2e9ebf6dace tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:39.009553 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-629dde4e-0d69-4942-8833-e2e9ebf6dace tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:39.010040 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-629dde4e-0d69-4942-8833-e2e9ebf6dace tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:39.010474 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-629dde4e-0d69-4942-8833-e2e9ebf6dace tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:39.011161 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-629dde4e-0d69-4942-8833-e2e9ebf6dace tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:39.011609 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-629dde4e-0d69-4942-8833-e2e9ebf6dace tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:39.012029 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-629dde4e-0d69-4942-8833-e2e9ebf6dace tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:39.077820 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-4a429509-f654-4001-b7df-c4b0d697e362 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a425027e59242bba6b05407d19cac82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032ed1b5aea842edb0bcae9d23810786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:39.086726 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-4a429509-f654-4001-b7df-c4b0d697e362 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] 10.222.0.59 "GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e" status: 200 len: 1314 microversion: 2.1 time: 0.172474 Aug 26 00:54:39.087396 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 72/145] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:38 2022] GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:39.151987 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-629dde4e-0d69-4942-8833-e2e9ebf6dace tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:39.161513 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-629dde4e-0d69-4942-8833-e2e9ebf6dace tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:39.163732 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-629dde4e-0d69-4942-8833-e2e9ebf6dace tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:39.165129 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-629dde4e-0d69-4942-8833-e2e9ebf6dace tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1406 microversion: 2.20 time: 0.166657 Aug 26 00:54:39.166267 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 74/146] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:54:38 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 00:54:39.296260 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-65259598-a063-438d-87d8-a79a06f41bd2 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:39.296785 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-65259598-a063-438d-87d8-a79a06f41bd2 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:39.303637 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-65259598-a063-438d-87d8-a79a06f41bd2 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:39.304250 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-65259598-a063-438d-87d8-a79a06f41bd2 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:39.304821 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-65259598-a063-438d-87d8-a79a06f41bd2 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:39.305643 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-65259598-a063-438d-87d8-a79a06f41bd2 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:39.306217 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-65259598-a063-438d-87d8-a79a06f41bd2 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:39.309851 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-65259598-a063-438d-87d8-a79a06f41bd2 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:39.458406 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-65259598-a063-438d-87d8-a79a06f41bd2 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:39.466189 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-65259598-a063-438d-87d8-a79a06f41bd2 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1322 microversion: 2.1 time: 0.174674 Aug 26 00:54:39.466840 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 73/147] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:39 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:39.835802 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-9a93e61e-1d81-4ed1-b5ef-35d2b72b57a9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:39.836417 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-9a93e61e-1d81-4ed1-b5ef-35d2b72b57a9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:39.843179 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9a93e61e-1d81-4ed1-b5ef-35d2b72b57a9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:39.843838 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9a93e61e-1d81-4ed1-b5ef-35d2b72b57a9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:39.844417 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9a93e61e-1d81-4ed1-b5ef-35d2b72b57a9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:39.845634 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9a93e61e-1d81-4ed1-b5ef-35d2b72b57a9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:39.846188 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9a93e61e-1d81-4ed1-b5ef-35d2b72b57a9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:39.846798 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9a93e61e-1d81-4ed1-b5ef-35d2b72b57a9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:40.038909 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-9a93e61e-1d81-4ed1-b5ef-35d2b72b57a9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:40.048169 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-9a93e61e-1d81-4ed1-b5ef-35d2b72b57a9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1362 microversion: 2.1 time: 0.216625 Aug 26 00:54:40.049122 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 75/148] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:39 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1362 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:40.107506 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-ad728422-ac9e-475a-a56c-2e904f9638b1 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:40.108197 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-ad728422-ac9e-475a-a56c-2e904f9638b1 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] [instance: d778c4bb-8dd8-4106-b7cc-12a1d485cf1e] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:40.114782 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ad728422-ac9e-475a-a56c-2e904f9638b1 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:40.115265 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ad728422-ac9e-475a-a56c-2e904f9638b1 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:40.115701 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ad728422-ac9e-475a-a56c-2e904f9638b1 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:40.116388 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ad728422-ac9e-475a-a56c-2e904f9638b1 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:40.116872 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ad728422-ac9e-475a-a56c-2e904f9638b1 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:40.117293 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ad728422-ac9e-475a-a56c-2e904f9638b1 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:40.196980 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-c50280e5-b1c1-4742-9ca3-43129a4ceda1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:40.198474 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-c50280e5-b1c1-4742-9ca3-43129a4ceda1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:40.208297 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c50280e5-b1c1-4742-9ca3-43129a4ceda1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:40.209038 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c50280e5-b1c1-4742-9ca3-43129a4ceda1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:40.209812 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c50280e5-b1c1-4742-9ca3-43129a4ceda1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:40.210685 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c50280e5-b1c1-4742-9ca3-43129a4ceda1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:40.213351 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c50280e5-b1c1-4742-9ca3-43129a4ceda1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:40.215186 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c50280e5-b1c1-4742-9ca3-43129a4ceda1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:40.283759 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-ad728422-ac9e-475a-a56c-2e904f9638b1 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a425027e59242bba6b05407d19cac82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032ed1b5aea842edb0bcae9d23810786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:40.293516 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-ad728422-ac9e-475a-a56c-2e904f9638b1 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] 10.222.0.59 "GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e" status: 200 len: 1314 microversion: 2.1 time: 0.189663 Aug 26 00:54:40.294273 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 74/149] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:40 2022] GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:40.385280 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-c50280e5-b1c1-4742-9ca3-43129a4ceda1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:40.392272 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [req-0dbbdeec-9dbb-4c54-b8ed-f22812490366 req-a12e67f5-98fa-4234-9d3a-9349f3884bf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7502d0cf-4abc-484b-8c85-d8ea6682333b", "name": "network-vif-plugged", "status": "completed", "tag": "ee6ad2fb-f57e-474d-a46b-a0d19ae36479"}]} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:54:40.395289 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-c50280e5-b1c1-4742-9ca3-43129a4ceda1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:40.397749 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-c50280e5-b1c1-4742-9ca3-43129a4ceda1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:40.398946 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-c50280e5-b1c1-4742-9ca3-43129a4ceda1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1406 microversion: 2.20 time: 0.215138 Aug 26 00:54:40.399823 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 76/150] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:54:40 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1406 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 00:54:40.406130 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-0dbbdeec-9dbb-4c54-b8ed-f22812490366 req-a12e67f5-98fa-4234-9d3a-9349f3884bf6 service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:40.406661 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-0dbbdeec-9dbb-4c54-b8ed-f22812490366 req-a12e67f5-98fa-4234-9d3a-9349f3884bf6 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:40.412551 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-0dbbdeec-9dbb-4c54-b8ed-f22812490366 req-a12e67f5-98fa-4234-9d3a-9349f3884bf6 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:40.439822 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.compute.server_external_events [req-0dbbdeec-9dbb-4c54-b8ed-f22812490366 req-a12e67f5-98fa-4234-9d3a-9349f3884bf6 service nova] Creating event network-vif-plugged:ee6ad2fb-f57e-474d-a46b-a0d19ae36479 for instance 7502d0cf-4abc-484b-8c85-d8ea6682333b on hv-cinder-83538 Aug 26 00:54:40.446482 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [req-0dbbdeec-9dbb-4c54-b8ed-f22812490366 req-a12e67f5-98fa-4234-9d3a-9349f3884bf6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058325 Aug 26 00:54:40.447384 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 75/151] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 00:54:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 00:54:40.489657 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-2bd08c7f-28c0-4d11-8af6-13659bcff3f8 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:40.490270 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-2bd08c7f-28c0-4d11-8af6-13659bcff3f8 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:40.496337 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2bd08c7f-28c0-4d11-8af6-13659bcff3f8 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:40.497058 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2bd08c7f-28c0-4d11-8af6-13659bcff3f8 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:40.497659 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2bd08c7f-28c0-4d11-8af6-13659bcff3f8 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:40.498418 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2bd08c7f-28c0-4d11-8af6-13659bcff3f8 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:40.499005 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2bd08c7f-28c0-4d11-8af6-13659bcff3f8 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:40.499427 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2bd08c7f-28c0-4d11-8af6-13659bcff3f8 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:40.635926 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-2bd08c7f-28c0-4d11-8af6-13659bcff3f8 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:40.643716 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-2bd08c7f-28c0-4d11-8af6-13659bcff3f8 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1322 microversion: 2.1 time: 0.157984 Aug 26 00:54:40.644368 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 77/152] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:40 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:41.071224 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-ecf90e43-a8d5-4003-83a9-f4a436d51f8c tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:41.071919 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-ecf90e43-a8d5-4003-83a9-f4a436d51f8c tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:41.078072 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ecf90e43-a8d5-4003-83a9-f4a436d51f8c tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:41.078557 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ecf90e43-a8d5-4003-83a9-f4a436d51f8c tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:41.078994 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ecf90e43-a8d5-4003-83a9-f4a436d51f8c tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:41.079729 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ecf90e43-a8d5-4003-83a9-f4a436d51f8c tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:41.080145 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ecf90e43-a8d5-4003-83a9-f4a436d51f8c tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:41.080591 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ecf90e43-a8d5-4003-83a9-f4a436d51f8c tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:41.226707 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-ecf90e43-a8d5-4003-83a9-f4a436d51f8c tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:41.234885 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-ecf90e43-a8d5-4003-83a9-f4a436d51f8c tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1362 microversion: 2.1 time: 0.168574 Aug 26 00:54:41.235462 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 76/153] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:41 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:41.314844 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-34018d30-cdfe-4b15-8004-0efb3331480b tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:41.315457 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-34018d30-cdfe-4b15-8004-0efb3331480b tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] [instance: d778c4bb-8dd8-4106-b7cc-12a1d485cf1e] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:41.321526 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-34018d30-cdfe-4b15-8004-0efb3331480b tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:41.322009 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-34018d30-cdfe-4b15-8004-0efb3331480b tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:41.322443 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-34018d30-cdfe-4b15-8004-0efb3331480b tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:41.323125 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-34018d30-cdfe-4b15-8004-0efb3331480b tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:41.323572 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-34018d30-cdfe-4b15-8004-0efb3331480b tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:41.324041 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-34018d30-cdfe-4b15-8004-0efb3331480b tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:41.426673 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-87e1802f-c3f4-4522-a9f0-16eaa3ae94f4 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:41.427358 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-87e1802f-c3f4-4522-a9f0-16eaa3ae94f4 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:41.433973 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-87e1802f-c3f4-4522-a9f0-16eaa3ae94f4 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:41.434705 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-87e1802f-c3f4-4522-a9f0-16eaa3ae94f4 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:41.435348 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-87e1802f-c3f4-4522-a9f0-16eaa3ae94f4 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:41.437474 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-87e1802f-c3f4-4522-a9f0-16eaa3ae94f4 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:41.437474 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-87e1802f-c3f4-4522-a9f0-16eaa3ae94f4 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:41.437474 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-87e1802f-c3f4-4522-a9f0-16eaa3ae94f4 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:41.482628 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-34018d30-cdfe-4b15-8004-0efb3331480b tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a425027e59242bba6b05407d19cac82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032ed1b5aea842edb0bcae9d23810786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:41.490852 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-34018d30-cdfe-4b15-8004-0efb3331480b tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] 10.222.0.59 "GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e" status: 200 len: 1314 microversion: 2.1 time: 0.179544 Aug 26 00:54:41.494140 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 78/154] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:41 2022] GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:41.599797 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-87e1802f-c3f4-4522-a9f0-16eaa3ae94f4 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:41.607917 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-87e1802f-c3f4-4522-a9f0-16eaa3ae94f4 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:41.609361 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-87e1802f-c3f4-4522-a9f0-16eaa3ae94f4 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:41.610442 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-87e1802f-c3f4-4522-a9f0-16eaa3ae94f4 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1406 microversion: 2.20 time: 0.190565 Aug 26 00:54:41.611012 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 77/155] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:54:41 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1406 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 00:54:41.665249 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-f0c3fe68-e620-456f-bc32-7c4b35c46cb4 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:41.669100 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-f0c3fe68-e620-456f-bc32-7c4b35c46cb4 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:41.672111 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_api:SELECT=100 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:54:41.675574 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f0c3fe68-e620-456f-bc32-7c4b35c46cb4 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:41.676612 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f0c3fe68-e620-456f-bc32-7c4b35c46cb4 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:41.677050 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f0c3fe68-e620-456f-bc32-7c4b35c46cb4 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:41.677737 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f0c3fe68-e620-456f-bc32-7c4b35c46cb4 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:41.678186 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f0c3fe68-e620-456f-bc32-7c4b35c46cb4 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:41.678606 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f0c3fe68-e620-456f-bc32-7c4b35c46cb4 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:41.813274 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-f0c3fe68-e620-456f-bc32-7c4b35c46cb4 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:41.821323 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-f0c3fe68-e620-456f-bc32-7c4b35c46cb4 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1322 microversion: 2.1 time: 0.160136 Aug 26 00:54:41.821884 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 79/156] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:41 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:42.259285 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-f0f99f91-b7bf-4640-a4b1-32c429c98baa tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:42.260523 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-f0f99f91-b7bf-4640-a4b1-32c429c98baa tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:42.266494 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f0f99f91-b7bf-4640-a4b1-32c429c98baa tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:42.266976 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f0f99f91-b7bf-4640-a4b1-32c429c98baa tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:42.267410 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f0f99f91-b7bf-4640-a4b1-32c429c98baa tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:42.268122 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f0f99f91-b7bf-4640-a4b1-32c429c98baa tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:42.268602 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f0f99f91-b7bf-4640-a4b1-32c429c98baa tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:42.269028 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f0f99f91-b7bf-4640-a4b1-32c429c98baa tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:42.400264 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-f0f99f91-b7bf-4640-a4b1-32c429c98baa tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:42.408102 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-f0f99f91-b7bf-4640-a4b1-32c429c98baa tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1362 microversion: 2.1 time: 0.152582 Aug 26 00:54:42.408705 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 78/157] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:42 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:42.511544 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-4a60fe5b-00c8-4795-98ef-d855cba331c2 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:42.512152 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-4a60fe5b-00c8-4795-98ef-d855cba331c2 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] [instance: d778c4bb-8dd8-4106-b7cc-12a1d485cf1e] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:42.518064 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-4a60fe5b-00c8-4795-98ef-d855cba331c2 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:42.518550 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-4a60fe5b-00c8-4795-98ef-d855cba331c2 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:42.518984 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-4a60fe5b-00c8-4795-98ef-d855cba331c2 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:42.519696 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-4a60fe5b-00c8-4795-98ef-d855cba331c2 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:42.520149 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-4a60fe5b-00c8-4795-98ef-d855cba331c2 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:42.520801 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-4a60fe5b-00c8-4795-98ef-d855cba331c2 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:42.634600 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-6a917f8b-7741-4662-b74c-7841c580dbc0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:42.635208 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-6a917f8b-7741-4662-b74c-7841c580dbc0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:42.641379 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6a917f8b-7741-4662-b74c-7841c580dbc0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:42.642018 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6a917f8b-7741-4662-b74c-7841c580dbc0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:42.642453 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6a917f8b-7741-4662-b74c-7841c580dbc0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:42.643141 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6a917f8b-7741-4662-b74c-7841c580dbc0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:42.643594 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6a917f8b-7741-4662-b74c-7841c580dbc0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:42.644025 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6a917f8b-7741-4662-b74c-7841c580dbc0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:42.649319 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-4a60fe5b-00c8-4795-98ef-d855cba331c2 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a425027e59242bba6b05407d19cac82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032ed1b5aea842edb0bcae9d23810786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:42.657334 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-4a60fe5b-00c8-4795-98ef-d855cba331c2 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] 10.222.0.59 "GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e" status: 200 len: 1314 microversion: 2.1 time: 0.149602 Aug 26 00:54:42.657907 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 80/158] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:42 2022] GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:42.775047 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-6a917f8b-7741-4662-b74c-7841c580dbc0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:42.784030 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-6a917f8b-7741-4662-b74c-7841c580dbc0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:42.786413 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-6a917f8b-7741-4662-b74c-7841c580dbc0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:42.787515 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-6a917f8b-7741-4662-b74c-7841c580dbc0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1406 microversion: 2.20 time: 0.157037 Aug 26 00:54:42.788062 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 79/159] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:54:42 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 00:54:42.841995 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-2cec0865-37a0-4bed-8944-d00487773f5d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:42.842596 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-2cec0865-37a0-4bed-8944-d00487773f5d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:42.849013 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2cec0865-37a0-4bed-8944-d00487773f5d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:42.849487 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2cec0865-37a0-4bed-8944-d00487773f5d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:42.849910 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2cec0865-37a0-4bed-8944-d00487773f5d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:42.850583 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2cec0865-37a0-4bed-8944-d00487773f5d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:42.851022 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2cec0865-37a0-4bed-8944-d00487773f5d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:42.851438 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2cec0865-37a0-4bed-8944-d00487773f5d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:42.979936 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-2cec0865-37a0-4bed-8944-d00487773f5d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:42.987507 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-2cec0865-37a0-4bed-8944-d00487773f5d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1322 microversion: 2.1 time: 0.149298 Aug 26 00:54:42.988058 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 81/160] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:42 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:43.429328 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-7fad9441-6ddd-44a5-a38e-e8bfd46adaf9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:43.429940 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-7fad9441-6ddd-44a5-a38e-e8bfd46adaf9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:43.436675 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7fad9441-6ddd-44a5-a38e-e8bfd46adaf9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:43.437195 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7fad9441-6ddd-44a5-a38e-e8bfd46adaf9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:43.437666 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7fad9441-6ddd-44a5-a38e-e8bfd46adaf9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:43.438309 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7fad9441-6ddd-44a5-a38e-e8bfd46adaf9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:43.438764 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7fad9441-6ddd-44a5-a38e-e8bfd46adaf9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:43.439187 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7fad9441-6ddd-44a5-a38e-e8bfd46adaf9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:43.573556 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-7fad9441-6ddd-44a5-a38e-e8bfd46adaf9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:43.582987 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-7fad9441-6ddd-44a5-a38e-e8bfd46adaf9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1362 microversion: 2.1 time: 0.156908 Aug 26 00:54:43.583555 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 80/161] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:43 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:43.678389 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-ec6f1758-9150-41f7-98ad-6c0a4c87a848 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:43.678951 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-ec6f1758-9150-41f7-98ad-6c0a4c87a848 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] [instance: d778c4bb-8dd8-4106-b7cc-12a1d485cf1e] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:43.685076 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ec6f1758-9150-41f7-98ad-6c0a4c87a848 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:43.685555 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ec6f1758-9150-41f7-98ad-6c0a4c87a848 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:43.685991 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ec6f1758-9150-41f7-98ad-6c0a4c87a848 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:43.686672 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ec6f1758-9150-41f7-98ad-6c0a4c87a848 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:43.687121 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ec6f1758-9150-41f7-98ad-6c0a4c87a848 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:43.687543 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ec6f1758-9150-41f7-98ad-6c0a4c87a848 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:43.810440 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-6e5ce8cf-3908-4bbb-ad6d-b859c7f3b936 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:43.811198 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-6e5ce8cf-3908-4bbb-ad6d-b859c7f3b936 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:43.817005 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-ec6f1758-9150-41f7-98ad-6c0a4c87a848 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a425027e59242bba6b05407d19cac82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032ed1b5aea842edb0bcae9d23810786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:43.818163 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6e5ce8cf-3908-4bbb-ad6d-b859c7f3b936 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:43.818644 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6e5ce8cf-3908-4bbb-ad6d-b859c7f3b936 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:43.819065 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6e5ce8cf-3908-4bbb-ad6d-b859c7f3b936 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:43.819975 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6e5ce8cf-3908-4bbb-ad6d-b859c7f3b936 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:43.820414 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6e5ce8cf-3908-4bbb-ad6d-b859c7f3b936 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:43.821230 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6e5ce8cf-3908-4bbb-ad6d-b859c7f3b936 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:43.825421 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-ec6f1758-9150-41f7-98ad-6c0a4c87a848 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] 10.222.0.59 "GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e" status: 200 len: 1314 microversion: 2.1 time: 0.150910 Aug 26 00:54:43.826072 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 82/162] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:43 2022] GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:43.947944 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-6e5ce8cf-3908-4bbb-ad6d-b859c7f3b936 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:43.956155 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-6e5ce8cf-3908-4bbb-ad6d-b859c7f3b936 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:43.958319 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-6e5ce8cf-3908-4bbb-ad6d-b859c7f3b936 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:43.959422 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-6e5ce8cf-3908-4bbb-ad6d-b859c7f3b936 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1406 microversion: 2.20 time: 0.152739 Aug 26 00:54:43.959975 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 81/163] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:54:43 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:54:44.007462 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-6c3dca65-cc2a-4fd2-b734-820366da07ed tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:44.008181 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-6c3dca65-cc2a-4fd2-b734-820366da07ed tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:44.014100 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6c3dca65-cc2a-4fd2-b734-820366da07ed tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:44.014589 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6c3dca65-cc2a-4fd2-b734-820366da07ed tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:44.015026 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6c3dca65-cc2a-4fd2-b734-820366da07ed tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:44.015705 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6c3dca65-cc2a-4fd2-b734-820366da07ed tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:44.016160 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6c3dca65-cc2a-4fd2-b734-820366da07ed tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:44.016617 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6c3dca65-cc2a-4fd2-b734-820366da07ed tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:44.143330 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-6c3dca65-cc2a-4fd2-b734-820366da07ed tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:44.151510 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-6c3dca65-cc2a-4fd2-b734-820366da07ed tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1322 microversion: 2.1 time: 0.147938 Aug 26 00:54:44.152062 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 83/164] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:44 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:44.603849 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-d8a15527-1640-4ad9-a827-c5a0a1af635c tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:44.604487 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-d8a15527-1640-4ad9-a827-c5a0a1af635c tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:44.610910 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d8a15527-1640-4ad9-a827-c5a0a1af635c tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:44.611396 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d8a15527-1640-4ad9-a827-c5a0a1af635c tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:44.611831 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d8a15527-1640-4ad9-a827-c5a0a1af635c tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:44.612569 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d8a15527-1640-4ad9-a827-c5a0a1af635c tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:44.613074 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d8a15527-1640-4ad9-a827-c5a0a1af635c tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:44.614004 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d8a15527-1640-4ad9-a827-c5a0a1af635c tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:44.755859 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-d8a15527-1640-4ad9-a827-c5a0a1af635c tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:44.763522 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-d8a15527-1640-4ad9-a827-c5a0a1af635c tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1362 microversion: 2.1 time: 0.163638 Aug 26 00:54:44.764109 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 82/165] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:44 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:44.847685 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-9660cb94-1515-472d-a066-45a565e55f46 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:44.848377 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-9660cb94-1515-472d-a066-45a565e55f46 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] [instance: d778c4bb-8dd8-4106-b7cc-12a1d485cf1e] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:44.854504 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9660cb94-1515-472d-a066-45a565e55f46 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:44.854987 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9660cb94-1515-472d-a066-45a565e55f46 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:44.855419 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9660cb94-1515-472d-a066-45a565e55f46 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:44.856097 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9660cb94-1515-472d-a066-45a565e55f46 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:44.856645 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9660cb94-1515-472d-a066-45a565e55f46 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:44.857116 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9660cb94-1515-472d-a066-45a565e55f46 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:44.982704 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-42727841-9b10-4f3a-bb12-7b47142aaa10 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:44.983723 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-42727841-9b10-4f3a-bb12-7b47142aaa10 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:44.989996 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-42727841-9b10-4f3a-bb12-7b47142aaa10 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:44.990730 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-42727841-9b10-4f3a-bb12-7b47142aaa10 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:44.991322 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-42727841-9b10-4f3a-bb12-7b47142aaa10 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:44.992142 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-42727841-9b10-4f3a-bb12-7b47142aaa10 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:44.992827 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-42727841-9b10-4f3a-bb12-7b47142aaa10 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:44.993341 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-42727841-9b10-4f3a-bb12-7b47142aaa10 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:44.994052 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-9660cb94-1515-472d-a066-45a565e55f46 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a425027e59242bba6b05407d19cac82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032ed1b5aea842edb0bcae9d23810786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:45.001778 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-9660cb94-1515-472d-a066-45a565e55f46 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] 10.222.0.59 "GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e" status: 200 len: 1502 microversion: 2.1 time: 0.157995 Aug 26 00:54:45.002556 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 84/166] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:44 2022] GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e => generated 1502 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:45.126381 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-42727841-9b10-4f3a-bb12-7b47142aaa10 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:45.135561 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-42727841-9b10-4f3a-bb12-7b47142aaa10 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:45.137152 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-42727841-9b10-4f3a-bb12-7b47142aaa10 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:45.138256 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-42727841-9b10-4f3a-bb12-7b47142aaa10 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1406 microversion: 2.20 time: 0.159715 Aug 26 00:54:45.138814 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 83/167] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:54:44 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:54:45.173150 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-5a0326b5-eebe-4fd4-8587-dc094c0de316 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:45.173658 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-5a0326b5-eebe-4fd4-8587-dc094c0de316 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:45.180556 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5a0326b5-eebe-4fd4-8587-dc094c0de316 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:45.181044 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5a0326b5-eebe-4fd4-8587-dc094c0de316 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:45.181480 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5a0326b5-eebe-4fd4-8587-dc094c0de316 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:45.182180 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5a0326b5-eebe-4fd4-8587-dc094c0de316 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:45.182628 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5a0326b5-eebe-4fd4-8587-dc094c0de316 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:45.184098 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5a0326b5-eebe-4fd4-8587-dc094c0de316 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:45.201761 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell1:SELECT=100 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:54:45.314076 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-5a0326b5-eebe-4fd4-8587-dc094c0de316 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:45.322253 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-5a0326b5-eebe-4fd4-8587-dc094c0de316 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1322 microversion: 2.1 time: 0.153095 Aug 26 00:54:45.322810 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 85/168] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:45 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:45.786243 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-a1839402-faeb-4d56-b79e-1c938bd95dea tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:45.787763 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-a1839402-faeb-4d56-b79e-1c938bd95dea tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:45.794148 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a1839402-faeb-4d56-b79e-1c938bd95dea tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:45.794836 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a1839402-faeb-4d56-b79e-1c938bd95dea tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:45.800098 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a1839402-faeb-4d56-b79e-1c938bd95dea tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:45.800098 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a1839402-faeb-4d56-b79e-1c938bd95dea tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:45.800098 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a1839402-faeb-4d56-b79e-1c938bd95dea tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:45.800098 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a1839402-faeb-4d56-b79e-1c938bd95dea tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:45.959227 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-a1839402-faeb-4d56-b79e-1c938bd95dea tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:45.967721 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-a1839402-faeb-4d56-b79e-1c938bd95dea tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1362 microversion: 2.1 time: 0.187184 Aug 26 00:54:45.968332 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 84/169] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:45 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:46.161831 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-481a74e4-af8a-4df4-807c-d980f8c963e1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:46.162437 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-481a74e4-af8a-4df4-807c-d980f8c963e1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:46.168393 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-481a74e4-af8a-4df4-807c-d980f8c963e1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:46.168916 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-481a74e4-af8a-4df4-807c-d980f8c963e1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:46.169356 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-481a74e4-af8a-4df4-807c-d980f8c963e1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:46.170043 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-481a74e4-af8a-4df4-807c-d980f8c963e1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:46.170521 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-481a74e4-af8a-4df4-807c-d980f8c963e1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:46.170944 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-481a74e4-af8a-4df4-807c-d980f8c963e1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:46.301395 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-481a74e4-af8a-4df4-807c-d980f8c963e1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:46.309906 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-481a74e4-af8a-4df4-807c-d980f8c963e1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:46.311347 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-481a74e4-af8a-4df4-807c-d980f8c963e1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:46.312453 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-481a74e4-af8a-4df4-807c-d980f8c963e1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1406 microversion: 2.20 time: 0.155457 Aug 26 00:54:46.313017 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 86/170] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:54:46 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 00:54:46.343071 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-8ff6c769-eb86-48f2-87c8-ab87a15d3997 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:46.343680 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-8ff6c769-eb86-48f2-87c8-ab87a15d3997 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:46.350216 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8ff6c769-eb86-48f2-87c8-ab87a15d3997 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:46.350690 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8ff6c769-eb86-48f2-87c8-ab87a15d3997 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:46.351120 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8ff6c769-eb86-48f2-87c8-ab87a15d3997 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:46.351822 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8ff6c769-eb86-48f2-87c8-ab87a15d3997 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:46.352268 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8ff6c769-eb86-48f2-87c8-ab87a15d3997 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:46.352711 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8ff6c769-eb86-48f2-87c8-ab87a15d3997 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:46.478100 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-8ff6c769-eb86-48f2-87c8-ab87a15d3997 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:46.485978 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-8ff6c769-eb86-48f2-87c8-ab87a15d3997 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1322 microversion: 2.1 time: 0.146634 Aug 26 00:54:46.490323 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 85/171] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:46 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:46.990023 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-9ef9a2d0-bc53-42ab-9f91-e005db3e7e35 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:46.990845 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-9ef9a2d0-bc53-42ab-9f91-e005db3e7e35 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:46.995237 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-be91bc4b-9936-4dee-9f59-8735754028b6 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7f8045cc-945d-44d9-b501-8c34a1e3041b"}} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:54:46.996746 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9ef9a2d0-bc53-42ab-9f91-e005db3e7e35 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:46.997240 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9ef9a2d0-bc53-42ab-9f91-e005db3e7e35 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:46.997670 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9ef9a2d0-bc53-42ab-9f91-e005db3e7e35 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:46.998360 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9ef9a2d0-bc53-42ab-9f91-e005db3e7e35 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:46.998472 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-be91bc4b-9936-4dee-9f59-8735754028b6 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] [instance: d778c4bb-8dd8-4106-b7cc-12a1d485cf1e] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:46.998884 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9ef9a2d0-bc53-42ab-9f91-e005db3e7e35 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:46.999350 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9ef9a2d0-bc53-42ab-9f91-e005db3e7e35 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:47.001491 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_api:SELECT=100 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:54:47.005490 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-be91bc4b-9936-4dee-9f59-8735754028b6 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:47.006044 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-be91bc4b-9936-4dee-9f59-8735754028b6 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:47.006479 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-be91bc4b-9936-4dee-9f59-8735754028b6 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:47.007381 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-be91bc4b-9936-4dee-9f59-8735754028b6 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:47.007835 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-be91bc4b-9936-4dee-9f59-8735754028b6 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:47.008283 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-be91bc4b-9936-4dee-9f59-8735754028b6 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:47.036460 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell1:SELECT=100 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:54:47.162255 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-9ef9a2d0-bc53-42ab-9f91-e005db3e7e35 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:47.171244 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-9ef9a2d0-bc53-42ab-9f91-e005db3e7e35 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1362 microversion: 2.1 time: 0.185757 Aug 26 00:54:47.171832 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 87/172] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:46 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1362 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:47.334161 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-f74d726b-d05a-4dd2-af9d-ffcaf7992f03 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:47.334756 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-f74d726b-d05a-4dd2-af9d-ffcaf7992f03 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:47.340737 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f74d726b-d05a-4dd2-af9d-ffcaf7992f03 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:47.341226 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f74d726b-d05a-4dd2-af9d-ffcaf7992f03 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:47.343970 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f74d726b-d05a-4dd2-af9d-ffcaf7992f03 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:47.343970 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f74d726b-d05a-4dd2-af9d-ffcaf7992f03 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:47.343970 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f74d726b-d05a-4dd2-af9d-ffcaf7992f03 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:47.343970 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f74d726b-d05a-4dd2-af9d-ffcaf7992f03 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:47.479409 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-f74d726b-d05a-4dd2-af9d-ffcaf7992f03 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:47.489142 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-f74d726b-d05a-4dd2-af9d-ffcaf7992f03 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:47.490621 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-f74d726b-d05a-4dd2-af9d-ffcaf7992f03 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:47.491934 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-f74d726b-d05a-4dd2-af9d-ffcaf7992f03 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1406 microversion: 2.20 time: 0.161664 Aug 26 00:54:47.492542 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 88/173] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:54:47 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 00:54:47.511228 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-071890fe-75c5-4b97-99df-3c8b50248f91 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:47.511836 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-071890fe-75c5-4b97-99df-3c8b50248f91 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:47.517768 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-071890fe-75c5-4b97-99df-3c8b50248f91 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:47.518255 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-071890fe-75c5-4b97-99df-3c8b50248f91 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:47.518689 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-071890fe-75c5-4b97-99df-3c8b50248f91 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:47.519565 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-071890fe-75c5-4b97-99df-3c8b50248f91 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:47.520022 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-071890fe-75c5-4b97-99df-3c8b50248f91 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:47.521782 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-071890fe-75c5-4b97-99df-3c8b50248f91 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:47.667847 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-071890fe-75c5-4b97-99df-3c8b50248f91 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:47.676461 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-071890fe-75c5-4b97-99df-3c8b50248f91 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1517 microversion: 2.1 time: 0.168231 Aug 26 00:54:47.677110 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 89/174] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:47 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1517 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:47.698520 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-1513fc69-29f2-4b89-b432-453314b7f34c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:54:47.701307 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-1513fc69-29f2-4b89-b432-453314b7f34c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:47.707617 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1513fc69-29f2-4b89-b432-453314b7f34c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:47.708189 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1513fc69-29f2-4b89-b432-453314b7f34c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:47.710500 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1513fc69-29f2-4b89-b432-453314b7f34c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:47.711307 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1513fc69-29f2-4b89-b432-453314b7f34c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:47.711858 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1513fc69-29f2-4b89-b432-453314b7f34c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:47.712361 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1513fc69-29f2-4b89-b432-453314b7f34c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:47.773781 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.objects.instance [None req-1513fc69-29f2-4b89-b432-453314b7f34c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lazy-loading 'flavor' on Instance uuid 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be {{(pid=127564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 00:54:48.196802 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-1513fc69-29f2-4b89-b432-453314b7f34c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "POST /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be/action" status: 200 len: 32 microversion: 2.1 time: 0.499292 Aug 26 00:54:48.196802 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 90/175] 10.222.0.59 () {60 vars in 1278 bytes} [Fri Aug 26 00:54:47 2022] POST /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be/action => generated 32 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 26 00:54:48.205504 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-da9ca9dd-1921-4e31-9acb-83c1da2f21dc tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:48.209515 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-da9ca9dd-1921-4e31-9acb-83c1da2f21dc tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:48.217603 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-da9ca9dd-1921-4e31-9acb-83c1da2f21dc tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:48.218645 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-da9ca9dd-1921-4e31-9acb-83c1da2f21dc tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:48.219775 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-da9ca9dd-1921-4e31-9acb-83c1da2f21dc tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:48.230813 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-da9ca9dd-1921-4e31-9acb-83c1da2f21dc tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:48.230813 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-da9ca9dd-1921-4e31-9acb-83c1da2f21dc tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:48.230813 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-da9ca9dd-1921-4e31-9acb-83c1da2f21dc tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:48.377385 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-da9ca9dd-1921-4e31-9acb-83c1da2f21dc tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:48.385762 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-da9ca9dd-1921-4e31-9acb-83c1da2f21dc tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1362 microversion: 2.1 time: 0.187365 Aug 26 00:54:48.386320 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 91/176] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:48 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1362 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:48.390629 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-5c3c1629-3172-4e2f-872b-1254c4e063dd tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:48.391227 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-5c3c1629-3172-4e2f-872b-1254c4e063dd tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:48.397077 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5c3c1629-3172-4e2f-872b-1254c4e063dd tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:48.397554 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5c3c1629-3172-4e2f-872b-1254c4e063dd tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:48.397992 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5c3c1629-3172-4e2f-872b-1254c4e063dd tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:48.398678 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5c3c1629-3172-4e2f-872b-1254c4e063dd tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:48.399128 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5c3c1629-3172-4e2f-872b-1254c4e063dd tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:48.399541 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5c3c1629-3172-4e2f-872b-1254c4e063dd tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:48.529727 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-5c3c1629-3172-4e2f-872b-1254c4e063dd tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:48.539032 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-5c3c1629-3172-4e2f-872b-1254c4e063dd tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1523 microversion: 2.1 time: 0.151731 Aug 26 00:54:48.539607 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 92/177] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:48 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:48.551741 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-17f4769d-33ed-4adc-ba16-816be76c2869 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:48.551741 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-17f4769d-33ed-4adc-ba16-816be76c2869 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:48.551741 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-17f4769d-33ed-4adc-ba16-816be76c2869 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:48.552631 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-17f4769d-33ed-4adc-ba16-816be76c2869 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:48.552631 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-17f4769d-33ed-4adc-ba16-816be76c2869 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:48.552981 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-17f4769d-33ed-4adc-ba16-816be76c2869 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:48.553569 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-17f4769d-33ed-4adc-ba16-816be76c2869 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:48.553995 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-17f4769d-33ed-4adc-ba16-816be76c2869 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:48.694600 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-17f4769d-33ed-4adc-ba16-816be76c2869 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:48.703012 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-17f4769d-33ed-4adc-ba16-816be76c2869 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:48.704466 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-17f4769d-33ed-4adc-ba16-816be76c2869 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:48.705625 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-17f4769d-33ed-4adc-ba16-816be76c2869 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1406 microversion: 2.20 time: 0.165108 Aug 26 00:54:48.706160 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 93/178] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:54:48 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:54:49.406670 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-ed0cdbc6-1a15-43a4-992f-73230f92816a tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:49.407322 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-ed0cdbc6-1a15-43a4-992f-73230f92816a tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:49.414276 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ed0cdbc6-1a15-43a4-992f-73230f92816a tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:49.414757 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ed0cdbc6-1a15-43a4-992f-73230f92816a tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:49.415227 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ed0cdbc6-1a15-43a4-992f-73230f92816a tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:49.415937 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ed0cdbc6-1a15-43a4-992f-73230f92816a tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:49.416368 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ed0cdbc6-1a15-43a4-992f-73230f92816a tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:49.416825 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ed0cdbc6-1a15-43a4-992f-73230f92816a tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:49.545977 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-ed0cdbc6-1a15-43a4-992f-73230f92816a tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:49.553752 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-ed0cdbc6-1a15-43a4-992f-73230f92816a tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1548 microversion: 2.1 time: 0.151029 Aug 26 00:54:49.554368 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 94/179] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:49 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:54:49.560021 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-10097800-afbd-4ba3-b1b7-879ff1722665 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:49.560723 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-10097800-afbd-4ba3-b1b7-879ff1722665 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:49.567233 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-10097800-afbd-4ba3-b1b7-879ff1722665 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:49.571989 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-10097800-afbd-4ba3-b1b7-879ff1722665 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:49.571989 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-10097800-afbd-4ba3-b1b7-879ff1722665 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:49.571989 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-10097800-afbd-4ba3-b1b7-879ff1722665 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:49.571989 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-10097800-afbd-4ba3-b1b7-879ff1722665 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:49.572383 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-10097800-afbd-4ba3-b1b7-879ff1722665 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:49.655574 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-be91bc4b-9936-4dee-9f59-8735754028b6 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] 10.222.0.59 "POST /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.662062 Aug 26 00:54:49.656229 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 86/180] 10.222.0.59 () {60 vars in 1323 bytes} [Fri Aug 26 00:54:46 2022] POST /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e/os-volume_attachments => generated 194 bytes in 2666 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:54:49.663863 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-ea7a5b5b-3114-4eab-bcc1-5e99fc94af38 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:49.663863 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-ea7a5b5b-3114-4eab-bcc1-5e99fc94af38 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:49.669934 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ea7a5b5b-3114-4eab-bcc1-5e99fc94af38 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:49.670427 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ea7a5b5b-3114-4eab-bcc1-5e99fc94af38 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:49.670859 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ea7a5b5b-3114-4eab-bcc1-5e99fc94af38 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:49.671560 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ea7a5b5b-3114-4eab-bcc1-5e99fc94af38 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:49.672011 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ea7a5b5b-3114-4eab-bcc1-5e99fc94af38 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:49.672433 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ea7a5b5b-3114-4eab-bcc1-5e99fc94af38 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:49.707405 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-10097800-afbd-4ba3-b1b7-879ff1722665 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:49.715689 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-10097800-afbd-4ba3-b1b7-879ff1722665 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1523 microversion: 2.1 time: 0.159050 Aug 26 00:54:49.716927 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 95/181] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:49 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:54:49.731025 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-0fd6f122-e507-4e34-b067-4b1cf23ce19f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:49.731613 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-0fd6f122-e507-4e34-b067-4b1cf23ce19f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:49.738882 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-0fd6f122-e507-4e34-b067-4b1cf23ce19f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:49.739762 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-0fd6f122-e507-4e34-b067-4b1cf23ce19f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:49.740218 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-0fd6f122-e507-4e34-b067-4b1cf23ce19f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:49.741283 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-0fd6f122-e507-4e34-b067-4b1cf23ce19f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:49.741744 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-0fd6f122-e507-4e34-b067-4b1cf23ce19f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:49.742195 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-0fd6f122-e507-4e34-b067-4b1cf23ce19f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:49.766867 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-ea7a5b5b-3114-4eab-bcc1-5e99fc94af38 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.109320 Aug 26 00:54:49.767465 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 87/182] 10.222.0.59 () {58 vars in 1275 bytes} [Fri Aug 26 00:54:49 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7/os-interface => generated 284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:54:50.119787 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-0fd6f122-e507-4e34-b067-4b1cf23ce19f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:50.127922 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-0fd6f122-e507-4e34-b067-4b1cf23ce19f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:50.129461 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-0fd6f122-e507-4e34-b067-4b1cf23ce19f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:50.130640 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-0fd6f122-e507-4e34-b067-4b1cf23ce19f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1406 microversion: 2.20 time: 0.403545 Aug 26 00:54:50.131296 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 96/183] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:54:49 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1406 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 00:54:50.740619 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-7bc721c1-2dda-4ffa-9008-5599964d0dc1 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:50.742351 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-7bc721c1-2dda-4ffa-9008-5599964d0dc1 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:50.750980 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7bc721c1-2dda-4ffa-9008-5599964d0dc1 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:50.752195 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7bc721c1-2dda-4ffa-9008-5599964d0dc1 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:50.753075 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7bc721c1-2dda-4ffa-9008-5599964d0dc1 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:50.754611 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7bc721c1-2dda-4ffa-9008-5599964d0dc1 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:50.755259 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7bc721c1-2dda-4ffa-9008-5599964d0dc1 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:50.755826 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7bc721c1-2dda-4ffa-9008-5599964d0dc1 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:50.918445 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-7bc721c1-2dda-4ffa-9008-5599964d0dc1 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:50.940257 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-7bc721c1-2dda-4ffa-9008-5599964d0dc1 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1523 microversion: 2.1 time: 0.204885 Aug 26 00:54:50.962766 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 88/184] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:50 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1523 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:51.152516 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-bae6ce34-c544-4047-8898-a2ca38bf028d tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:51.153130 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-bae6ce34-c544-4047-8898-a2ca38bf028d tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:51.170554 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bae6ce34-c544-4047-8898-a2ca38bf028d tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:51.171048 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bae6ce34-c544-4047-8898-a2ca38bf028d tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:51.172029 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bae6ce34-c544-4047-8898-a2ca38bf028d tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:51.172771 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bae6ce34-c544-4047-8898-a2ca38bf028d tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:51.173225 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bae6ce34-c544-4047-8898-a2ca38bf028d tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:51.173647 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bae6ce34-c544-4047-8898-a2ca38bf028d tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:51.630327 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-bae6ce34-c544-4047-8898-a2ca38bf028d tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:51.640256 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-bae6ce34-c544-4047-8898-a2ca38bf028d tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:51.642003 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-bae6ce34-c544-4047-8898-a2ca38bf028d tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:51.668207 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-bae6ce34-c544-4047-8898-a2ca38bf028d tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1598 microversion: 2.20 time: 0.494921 Aug 26 00:54:51.668207 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 97/185] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:54:51 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1598 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:54:51.717041 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-312a9a83-9ef8-47b6-8cb0-1e70065a3f5f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:51.717567 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-312a9a83-9ef8-47b6-8cb0-1e70065a3f5f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:51.723844 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-312a9a83-9ef8-47b6-8cb0-1e70065a3f5f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:51.724330 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-312a9a83-9ef8-47b6-8cb0-1e70065a3f5f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:51.843266 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-312a9a83-9ef8-47b6-8cb0-1e70065a3f5f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:51.843266 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-312a9a83-9ef8-47b6-8cb0-1e70065a3f5f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:51.843266 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-312a9a83-9ef8-47b6-8cb0-1e70065a3f5f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:51.843266 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-312a9a83-9ef8-47b6-8cb0-1e70065a3f5f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:51.845757 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-312a9a83-9ef8-47b6-8cb0-1e70065a3f5f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.098599 Aug 26 00:54:51.845757 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 89/186] 10.222.0.59 () {60 vars in 1316 bytes} [Fri Aug 26 00:54:51 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 00:54:51.950721 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [req-14fcd5a7-2024-4e51-a03e-d7f6dd48daf0 req-110333fb-c1db-44ef-b3f1-0dc40558c79c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "730816fc-0c43-43e3-ab6e-e7f324e403d7", "tag": "9a9a5c66-fe0c-40d8-ae1a-65494e24310f"}]} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:54:51.969966 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-14fcd5a7-2024-4e51-a03e-d7f6dd48daf0 req-110333fb-c1db-44ef-b3f1-0dc40558c79c service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:51.970747 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-14fcd5a7-2024-4e51-a03e-d7f6dd48daf0 req-110333fb-c1db-44ef-b3f1-0dc40558c79c service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:51.971032 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-3795a582-b729-4d54-85a3-8e6387ac25f7 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:51.971788 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-3795a582-b729-4d54-85a3-8e6387ac25f7 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:51.971987 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-14fcd5a7-2024-4e51-a03e-d7f6dd48daf0 req-110333fb-c1db-44ef-b3f1-0dc40558c79c service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:51.979400 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3795a582-b729-4d54-85a3-8e6387ac25f7 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:51.980543 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3795a582-b729-4d54-85a3-8e6387ac25f7 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:51.981367 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3795a582-b729-4d54-85a3-8e6387ac25f7 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:51.982916 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3795a582-b729-4d54-85a3-8e6387ac25f7 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:51.983620 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3795a582-b729-4d54-85a3-8e6387ac25f7 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:51.984534 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3795a582-b729-4d54-85a3-8e6387ac25f7 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:52.000553 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.compute.server_external_events [req-14fcd5a7-2024-4e51-a03e-d7f6dd48daf0 req-110333fb-c1db-44ef-b3f1-0dc40558c79c service nova] Creating event network-changed:9a9a5c66-fe0c-40d8-ae1a-65494e24310f for instance 730816fc-0c43-43e3-ab6e-e7f324e403d7 on hv-cinder-83538 Aug 26 00:54:52.011528 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [req-14fcd5a7-2024-4e51-a03e-d7f6dd48daf0 req-110333fb-c1db-44ef-b3f1-0dc40558c79c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068583 Aug 26 00:54:52.012443 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 98/187] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 00:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:54:52.360296 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-3795a582-b729-4d54-85a3-8e6387ac25f7 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:52.369513 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-3795a582-b729-4d54-85a3-8e6387ac25f7 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1523 microversion: 2.1 time: 0.402724 Aug 26 00:54:52.370088 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 90/188] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:51 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1523 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:53.391788 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-ca6ea67b-fa2c-4914-82b6-10e1462c009f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:53.392545 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-ca6ea67b-fa2c-4914-82b6-10e1462c009f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:53.403088 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ca6ea67b-fa2c-4914-82b6-10e1462c009f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:53.403908 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ca6ea67b-fa2c-4914-82b6-10e1462c009f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:53.404608 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ca6ea67b-fa2c-4914-82b6-10e1462c009f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:53.405592 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ca6ea67b-fa2c-4914-82b6-10e1462c009f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:53.406050 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ca6ea67b-fa2c-4914-82b6-10e1462c009f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:53.406472 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ca6ea67b-fa2c-4914-82b6-10e1462c009f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:53.632408 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-ca6ea67b-fa2c-4914-82b6-10e1462c009f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:53.642714 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-ca6ea67b-fa2c-4914-82b6-10e1462c009f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1523 microversion: 2.1 time: 0.254807 Aug 26 00:54:53.643906 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 99/189] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:53 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1523 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:53.693560 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [req-1494fe74-541a-4259-9bc0-d3f84a89e606 req-f0875b1c-f49a-4d82-b7c0-245648978eec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7502d0cf-4abc-484b-8c85-d8ea6682333b", "tag": "ee6ad2fb-f57e-474d-a46b-a0d19ae36479"}]} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:54:53.703952 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-1494fe74-541a-4259-9bc0-d3f84a89e606 req-f0875b1c-f49a-4d82-b7c0-245648978eec service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:53.704967 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-1494fe74-541a-4259-9bc0-d3f84a89e606 req-f0875b1c-f49a-4d82-b7c0-245648978eec service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:53.705577 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-1494fe74-541a-4259-9bc0-d3f84a89e606 req-f0875b1c-f49a-4d82-b7c0-245648978eec service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:53.718262 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.compute.server_external_events [req-1494fe74-541a-4259-9bc0-d3f84a89e606 req-f0875b1c-f49a-4d82-b7c0-245648978eec service nova] Creating event network-changed:ee6ad2fb-f57e-474d-a46b-a0d19ae36479 for instance 7502d0cf-4abc-484b-8c85-d8ea6682333b on hv-cinder-83538 Aug 26 00:54:53.725030 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [req-1494fe74-541a-4259-9bc0-d3f84a89e606 req-f0875b1c-f49a-4d82-b7c0-245648978eec service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034552 Aug 26 00:54:53.730830 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 91/190] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 00:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:54:54.671905 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-22e81fce-01db-4c77-89d8-09452094547a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:54.675283 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-22e81fce-01db-4c77-89d8-09452094547a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:54.686633 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-22e81fce-01db-4c77-89d8-09452094547a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:54.687438 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-22e81fce-01db-4c77-89d8-09452094547a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:54.688044 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-22e81fce-01db-4c77-89d8-09452094547a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:54.689000 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-22e81fce-01db-4c77-89d8-09452094547a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:54.689608 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-22e81fce-01db-4c77-89d8-09452094547a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:54.690030 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-22e81fce-01db-4c77-89d8-09452094547a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:54.873125 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-22e81fce-01db-4c77-89d8-09452094547a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:54.875822 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:54:54.881593 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-22e81fce-01db-4c77-89d8-09452094547a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1523 microversion: 2.1 time: 0.219702 Aug 26 00:54:54.884837 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 100/191] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:54 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1523 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:55.905599 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-b43c1724-c550-4d84-beb8-2f04ff8e3356 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:55.906930 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-b43c1724-c550-4d84-beb8-2f04ff8e3356 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:55.918126 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b43c1724-c550-4d84-beb8-2f04ff8e3356 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:55.921231 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b43c1724-c550-4d84-beb8-2f04ff8e3356 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:55.921728 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b43c1724-c550-4d84-beb8-2f04ff8e3356 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:55.924325 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b43c1724-c550-4d84-beb8-2f04ff8e3356 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:55.925098 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b43c1724-c550-4d84-beb8-2f04ff8e3356 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:55.926277 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b43c1724-c550-4d84-beb8-2f04ff8e3356 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:56.147806 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-b43c1724-c550-4d84-beb8-2f04ff8e3356 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:56.156166 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-b43c1724-c550-4d84-beb8-2f04ff8e3356 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1523 microversion: 2.1 time: 0.256745 Aug 26 00:54:56.168501 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 92/192] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:55 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1523 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:57.179734 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-a4086875-ab92-41bc-8060-2135b48012fe tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:57.180353 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-a4086875-ab92-41bc-8060-2135b48012fe tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:57.186867 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a4086875-ab92-41bc-8060-2135b48012fe tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:57.187364 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a4086875-ab92-41bc-8060-2135b48012fe tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:57.188075 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a4086875-ab92-41bc-8060-2135b48012fe tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:57.207363 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a4086875-ab92-41bc-8060-2135b48012fe tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:57.207363 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a4086875-ab92-41bc-8060-2135b48012fe tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:57.207363 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a4086875-ab92-41bc-8060-2135b48012fe tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:57.348681 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-a4086875-ab92-41bc-8060-2135b48012fe tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:57.356727 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-a4086875-ab92-41bc-8060-2135b48012fe tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1523 microversion: 2.1 time: 0.181730 Aug 26 00:54:57.357599 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 101/193] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:57 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:58.380583 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-0518768f-6baf-49c2-8c01-24184d58aee5 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:58.381671 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-0518768f-6baf-49c2-8c01-24184d58aee5 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:58.388048 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0518768f-6baf-49c2-8c01-24184d58aee5 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:58.388708 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0518768f-6baf-49c2-8c01-24184d58aee5 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:58.393240 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0518768f-6baf-49c2-8c01-24184d58aee5 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:58.393240 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0518768f-6baf-49c2-8c01-24184d58aee5 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:58.393240 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0518768f-6baf-49c2-8c01-24184d58aee5 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:58.393240 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0518768f-6baf-49c2-8c01-24184d58aee5 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:58.576809 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-0518768f-6baf-49c2-8c01-24184d58aee5 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:58.578405 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-0518768f-6baf-49c2-8c01-24184d58aee5 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1523 microversion: 2.1 time: 0.203905 Aug 26 00:54:58.578970 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 93/194] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:58 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1523 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:54:59.600319 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-bedbff6e-d7c4-45cb-8615-6a896ad57855 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:54:59.601515 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-bedbff6e-d7c4-45cb-8615-6a896ad57855 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:54:59.608813 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bedbff6e-d7c4-45cb-8615-6a896ad57855 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:59.610477 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bedbff6e-d7c4-45cb-8615-6a896ad57855 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:59.611119 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bedbff6e-d7c4-45cb-8615-6a896ad57855 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:59.612440 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bedbff6e-d7c4-45cb-8615-6a896ad57855 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:54:59.613675 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bedbff6e-d7c4-45cb-8615-6a896ad57855 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:54:59.614288 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bedbff6e-d7c4-45cb-8615-6a896ad57855 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:54:59.750472 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-bedbff6e-d7c4-45cb-8615-6a896ad57855 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:54:59.758327 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-bedbff6e-d7c4-45cb-8615-6a896ad57855 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1523 microversion: 2.1 time: 0.162967 Aug 26 00:54:59.758891 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 102/195] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:54:59 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:00.779635 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-c0557700-814c-4cb0-8767-ed199e06f7e7 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:00.780274 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-c0557700-814c-4cb0-8767-ed199e06f7e7 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:00.787582 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c0557700-814c-4cb0-8767-ed199e06f7e7 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:00.788063 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c0557700-814c-4cb0-8767-ed199e06f7e7 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:00.788573 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c0557700-814c-4cb0-8767-ed199e06f7e7 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:00.789420 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c0557700-814c-4cb0-8767-ed199e06f7e7 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:00.789871 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c0557700-814c-4cb0-8767-ed199e06f7e7 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:00.790291 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c0557700-814c-4cb0-8767-ed199e06f7e7 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:00.924802 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-c0557700-814c-4cb0-8767-ed199e06f7e7 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:00.933306 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-c0557700-814c-4cb0-8767-ed199e06f7e7 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1523 microversion: 2.1 time: 0.157803 Aug 26 00:55:00.933875 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 94/196] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:00 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:01.955479 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-984b28b1-dae9-43be-a6b7-97fe36c97a20 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:01.959952 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-984b28b1-dae9-43be-a6b7-97fe36c97a20 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:01.962379 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-984b28b1-dae9-43be-a6b7-97fe36c97a20 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:01.962860 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-984b28b1-dae9-43be-a6b7-97fe36c97a20 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:01.963290 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-984b28b1-dae9-43be-a6b7-97fe36c97a20 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:01.963968 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-984b28b1-dae9-43be-a6b7-97fe36c97a20 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:01.964418 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-984b28b1-dae9-43be-a6b7-97fe36c97a20 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:01.964856 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-984b28b1-dae9-43be-a6b7-97fe36c97a20 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:02.099260 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-984b28b1-dae9-43be-a6b7-97fe36c97a20 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:02.107002 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-984b28b1-dae9-43be-a6b7-97fe36c97a20 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1523 microversion: 2.1 time: 0.155519 Aug 26 00:55:02.107560 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 103/197] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:01 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:03.133288 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-271e0b1f-a836-4966-a041-4c380d209325 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:03.133288 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-271e0b1f-a836-4966-a041-4c380d209325 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:03.137302 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-271e0b1f-a836-4966-a041-4c380d209325 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:03.137792 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-271e0b1f-a836-4966-a041-4c380d209325 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:03.138434 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-271e0b1f-a836-4966-a041-4c380d209325 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:03.139267 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-271e0b1f-a836-4966-a041-4c380d209325 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:03.141257 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-271e0b1f-a836-4966-a041-4c380d209325 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:03.142249 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-271e0b1f-a836-4966-a041-4c380d209325 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:03.297040 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-271e0b1f-a836-4966-a041-4c380d209325 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:03.305307 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-271e0b1f-a836-4966-a041-4c380d209325 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1523 microversion: 2.1 time: 0.181055 Aug 26 00:55:03.305870 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 95/198] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:03 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:04.335985 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-98b3419c-9012-4264-98c8-b0c80c1d6dd6 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:04.335985 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-98b3419c-9012-4264-98c8-b0c80c1d6dd6 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:04.338540 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-98b3419c-9012-4264-98c8-b0c80c1d6dd6 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:04.339026 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-98b3419c-9012-4264-98c8-b0c80c1d6dd6 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:04.339542 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-98b3419c-9012-4264-98c8-b0c80c1d6dd6 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:04.340158 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-98b3419c-9012-4264-98c8-b0c80c1d6dd6 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:04.340641 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-98b3419c-9012-4264-98c8-b0c80c1d6dd6 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:04.341069 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-98b3419c-9012-4264-98c8-b0c80c1d6dd6 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:04.471932 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-98b3419c-9012-4264-98c8-b0c80c1d6dd6 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:04.479809 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-98b3419c-9012-4264-98c8-b0c80c1d6dd6 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1523 microversion: 2.1 time: 0.152116 Aug 26 00:55:04.480658 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 104/199] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:04 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:04.999376 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-70de4d16-c286-42e1-95ed-711001df9152 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:04.999901 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-70de4d16-c286-42e1-95ed-711001df9152 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] [instance: d778c4bb-8dd8-4106-b7cc-12a1d485cf1e] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:05.006729 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-70de4d16-c286-42e1-95ed-711001df9152 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:05.007511 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-70de4d16-c286-42e1-95ed-711001df9152 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:05.008173 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-70de4d16-c286-42e1-95ed-711001df9152 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:05.008865 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-70de4d16-c286-42e1-95ed-711001df9152 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:05.009629 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-70de4d16-c286-42e1-95ed-711001df9152 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:05.010387 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-70de4d16-c286-42e1-95ed-711001df9152 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:05.037529 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-70de4d16-c286-42e1-95ed-711001df9152 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] [instance: d778c4bb-8dd8-4106-b7cc-12a1d485cf1e] Going to try to terminate instance {{(pid=127565) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 00:55:05.410470 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-70de4d16-c286-42e1-95ed-711001df9152 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] 10.222.0.59 "DELETE /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e" status: 204 len: 0 microversion: 2.1 time: 0.414223 Aug 26 00:55:05.411055 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 96/200] 10.222.0.59 () {58 vars in 1239 bytes} [Fri Aug 26 00:55:04 2022] DELETE /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 00:55:05.426264 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-99944c82-d82a-43d8-b3c8-1deb0b8306d7 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:05.427140 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-99944c82-d82a-43d8-b3c8-1deb0b8306d7 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] [instance: d778c4bb-8dd8-4106-b7cc-12a1d485cf1e] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:05.434196 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-99944c82-d82a-43d8-b3c8-1deb0b8306d7 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:05.434688 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-99944c82-d82a-43d8-b3c8-1deb0b8306d7 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:05.435126 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-99944c82-d82a-43d8-b3c8-1deb0b8306d7 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:05.435822 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-99944c82-d82a-43d8-b3c8-1deb0b8306d7 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:05.436278 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-99944c82-d82a-43d8-b3c8-1deb0b8306d7 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:05.436730 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-99944c82-d82a-43d8-b3c8-1deb0b8306d7 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:05.508318 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-8f4b78e3-a8ac-430d-b692-de584c6fe595 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:05.509060 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-8f4b78e3-a8ac-430d-b692-de584c6fe595 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:05.515363 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8f4b78e3-a8ac-430d-b692-de584c6fe595 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:05.515855 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8f4b78e3-a8ac-430d-b692-de584c6fe595 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:05.516324 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8f4b78e3-a8ac-430d-b692-de584c6fe595 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:05.517047 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8f4b78e3-a8ac-430d-b692-de584c6fe595 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:05.517691 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8f4b78e3-a8ac-430d-b692-de584c6fe595 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:05.518112 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8f4b78e3-a8ac-430d-b692-de584c6fe595 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:05.588021 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-99944c82-d82a-43d8-b3c8-1deb0b8306d7 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a425027e59242bba6b05407d19cac82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032ed1b5aea842edb0bcae9d23810786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:05.598245 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-99944c82-d82a-43d8-b3c8-1deb0b8306d7 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] 10.222.0.59 "GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e" status: 200 len: 1554 microversion: 2.1 time: 0.181141 Aug 26 00:55:05.598962 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 105/201] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:05 2022] GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e => generated 1554 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:05.714617 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-8f4b78e3-a8ac-430d-b692-de584c6fe595 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:05.723247 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-8f4b78e3-a8ac-430d-b692-de584c6fe595 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1523 microversion: 2.1 time: 0.219958 Aug 26 00:55:05.723829 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 97/202] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:05 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1523 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:55:06.620086 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-e23b2f8a-1747-4029-8aae-ad9cc4f29842 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:06.621279 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-e23b2f8a-1747-4029-8aae-ad9cc4f29842 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] [instance: d778c4bb-8dd8-4106-b7cc-12a1d485cf1e] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:06.632939 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e23b2f8a-1747-4029-8aae-ad9cc4f29842 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:06.632939 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e23b2f8a-1747-4029-8aae-ad9cc4f29842 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:06.632939 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e23b2f8a-1747-4029-8aae-ad9cc4f29842 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:06.632939 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e23b2f8a-1747-4029-8aae-ad9cc4f29842 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:06.633260 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e23b2f8a-1747-4029-8aae-ad9cc4f29842 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:06.633342 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e23b2f8a-1747-4029-8aae-ad9cc4f29842 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:06.750547 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-245d1573-61c9-4cf8-a109-66c1b456db30 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:06.751273 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-245d1573-61c9-4cf8-a109-66c1b456db30 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:06.773528 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-245d1573-61c9-4cf8-a109-66c1b456db30 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:06.778774 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-245d1573-61c9-4cf8-a109-66c1b456db30 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:06.779338 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-245d1573-61c9-4cf8-a109-66c1b456db30 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:06.780720 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-245d1573-61c9-4cf8-a109-66c1b456db30 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:06.783077 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-245d1573-61c9-4cf8-a109-66c1b456db30 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:06.786748 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-245d1573-61c9-4cf8-a109-66c1b456db30 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:06.835927 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-e23b2f8a-1747-4029-8aae-ad9cc4f29842 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a425027e59242bba6b05407d19cac82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032ed1b5aea842edb0bcae9d23810786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:06.850239 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-e23b2f8a-1747-4029-8aae-ad9cc4f29842 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] 10.222.0.59 "GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e" status: 200 len: 1554 microversion: 2.1 time: 0.234327 Aug 26 00:55:06.863296 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 106/203] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:06 2022] GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e => generated 1554 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:07.155798 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-245d1573-61c9-4cf8-a109-66c1b456db30 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:07.166712 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-245d1573-61c9-4cf8-a109-66c1b456db30 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1523 microversion: 2.1 time: 0.425425 Aug 26 00:55:07.167621 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 98/204] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:06 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1523 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:07.871636 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-3757d9b1-47fa-4f3a-9922-4b3fd8bc02f8 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:07.872239 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-3757d9b1-47fa-4f3a-9922-4b3fd8bc02f8 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] [instance: d778c4bb-8dd8-4106-b7cc-12a1d485cf1e] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:07.878884 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3757d9b1-47fa-4f3a-9922-4b3fd8bc02f8 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:07.879371 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3757d9b1-47fa-4f3a-9922-4b3fd8bc02f8 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:07.879800 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3757d9b1-47fa-4f3a-9922-4b3fd8bc02f8 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:07.880512 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3757d9b1-47fa-4f3a-9922-4b3fd8bc02f8 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:07.880941 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3757d9b1-47fa-4f3a-9922-4b3fd8bc02f8 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:07.881356 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3757d9b1-47fa-4f3a-9922-4b3fd8bc02f8 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:08.084651 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-3757d9b1-47fa-4f3a-9922-4b3fd8bc02f8 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a425027e59242bba6b05407d19cac82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032ed1b5aea842edb0bcae9d23810786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:08.093230 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-3757d9b1-47fa-4f3a-9922-4b3fd8bc02f8 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] 10.222.0.59 "GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e" status: 200 len: 1554 microversion: 2.1 time: 0.225426 Aug 26 00:55:08.093809 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 107/205] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:07 2022] GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e => generated 1554 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:08.190304 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-57f58831-7fa2-473e-b90d-9fab815c2acd tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:08.191606 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-57f58831-7fa2-473e-b90d-9fab815c2acd tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:08.198141 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-57f58831-7fa2-473e-b90d-9fab815c2acd tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:08.198617 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-57f58831-7fa2-473e-b90d-9fab815c2acd tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:08.199044 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-57f58831-7fa2-473e-b90d-9fab815c2acd tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:08.200254 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-57f58831-7fa2-473e-b90d-9fab815c2acd tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:08.200746 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-57f58831-7fa2-473e-b90d-9fab815c2acd tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:08.201176 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-57f58831-7fa2-473e-b90d-9fab815c2acd tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:08.400509 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-57f58831-7fa2-473e-b90d-9fab815c2acd tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:08.408950 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-57f58831-7fa2-473e-b90d-9fab815c2acd tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1523 microversion: 2.1 time: 0.223591 Aug 26 00:55:08.410154 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 99/206] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:08 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1523 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:09.114943 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-8c5944fe-6dfb-4ed5-b97c-05ecb78c1c2a tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:09.115891 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-8c5944fe-6dfb-4ed5-b97c-05ecb78c1c2a tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] [instance: d778c4bb-8dd8-4106-b7cc-12a1d485cf1e] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:09.126995 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8c5944fe-6dfb-4ed5-b97c-05ecb78c1c2a tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:09.129452 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8c5944fe-6dfb-4ed5-b97c-05ecb78c1c2a tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:09.130090 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8c5944fe-6dfb-4ed5-b97c-05ecb78c1c2a tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:09.131029 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8c5944fe-6dfb-4ed5-b97c-05ecb78c1c2a tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:09.131866 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8c5944fe-6dfb-4ed5-b97c-05ecb78c1c2a tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:09.133619 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8c5944fe-6dfb-4ed5-b97c-05ecb78c1c2a tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:09.284422 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-8c5944fe-6dfb-4ed5-b97c-05ecb78c1c2a tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a425027e59242bba6b05407d19cac82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032ed1b5aea842edb0bcae9d23810786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:09.293836 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-8c5944fe-6dfb-4ed5-b97c-05ecb78c1c2a tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] 10.222.0.59 "GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e" status: 200 len: 1512 microversion: 2.1 time: 0.183440 Aug 26 00:55:09.295068 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 108/207] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:09 2022] GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e => generated 1512 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:09.326707 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [req-3b04ad96-f2a9-444f-96f5-25c79c195864 req-65d4d076-36d3-482a-a478-a5cbaecd24d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d778c4bb-8dd8-4106-b7cc-12a1d485cf1e", "name": "network-vif-deleted", "tag": "5f1c5b36-2ace-4432-8c74-20a3b6c61298"}]} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:55:09.339632 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-3b04ad96-f2a9-444f-96f5-25c79c195864 req-65d4d076-36d3-482a-a478-a5cbaecd24d1 service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:09.340107 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-3b04ad96-f2a9-444f-96f5-25c79c195864 req-65d4d076-36d3-482a-a478-a5cbaecd24d1 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:09.340546 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-3b04ad96-f2a9-444f-96f5-25c79c195864 req-65d4d076-36d3-482a-a478-a5cbaecd24d1 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:09.352623 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.compute.server_external_events [req-3b04ad96-f2a9-444f-96f5-25c79c195864 req-65d4d076-36d3-482a-a478-a5cbaecd24d1 service nova] Creating event network-vif-deleted:5f1c5b36-2ace-4432-8c74-20a3b6c61298 for instance d778c4bb-8dd8-4106-b7cc-12a1d485cf1e on hv-cinder-83538 Aug 26 00:55:09.359244 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [req-3b04ad96-f2a9-444f-96f5-25c79c195864 req-65d4d076-36d3-482a-a478-a5cbaecd24d1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035715 Aug 26 00:55:09.359844 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 100/208] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 00:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:55:09.431042 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-ed8a2b62-ad4f-41a2-b081-89db4344cae3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:09.432050 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-ed8a2b62-ad4f-41a2-b081-89db4344cae3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:09.438513 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ed8a2b62-ad4f-41a2-b081-89db4344cae3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:09.438913 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ed8a2b62-ad4f-41a2-b081-89db4344cae3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:09.440369 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ed8a2b62-ad4f-41a2-b081-89db4344cae3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:09.442090 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ed8a2b62-ad4f-41a2-b081-89db4344cae3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:09.442522 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ed8a2b62-ad4f-41a2-b081-89db4344cae3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:09.443011 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ed8a2b62-ad4f-41a2-b081-89db4344cae3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:09.646524 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-ed8a2b62-ad4f-41a2-b081-89db4344cae3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:09.655546 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-ed8a2b62-ad4f-41a2-b081-89db4344cae3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1523 microversion: 2.1 time: 0.228716 Aug 26 00:55:09.656136 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 109/209] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:09 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1523 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:10.316764 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-4b2a75ce-bd19-4535-80db-f03126e5833c tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:10.317968 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-4b2a75ce-bd19-4535-80db-f03126e5833c tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] [instance: d778c4bb-8dd8-4106-b7cc-12a1d485cf1e] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:10.324677 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4b2a75ce-bd19-4535-80db-f03126e5833c tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:10.325369 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4b2a75ce-bd19-4535-80db-f03126e5833c tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:10.327753 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4b2a75ce-bd19-4535-80db-f03126e5833c tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:10.327753 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4b2a75ce-bd19-4535-80db-f03126e5833c tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:10.327753 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4b2a75ce-bd19-4535-80db-f03126e5833c tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:10.327753 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4b2a75ce-bd19-4535-80db-f03126e5833c tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:10.394269 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-4b2a75ce-bd19-4535-80db-f03126e5833c tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a425027e59242bba6b05407d19cac82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032ed1b5aea842edb0bcae9d23810786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:10.397953 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:55:10.410828 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-4b2a75ce-bd19-4535-80db-f03126e5833c tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] 10.222.0.59 "GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e" status: 200 len: 1345 microversion: 2.1 time: 0.098831 Aug 26 00:55:10.411685 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 101/210] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:10 2022] GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e => generated 1345 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:10.678606 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-b2a83c93-96de-4f82-9322-966eb21cee4a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:10.679944 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-b2a83c93-96de-4f82-9322-966eb21cee4a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:10.688634 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b2a83c93-96de-4f82-9322-966eb21cee4a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:10.689568 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b2a83c93-96de-4f82-9322-966eb21cee4a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:10.690013 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b2a83c93-96de-4f82-9322-966eb21cee4a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:10.691262 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b2a83c93-96de-4f82-9322-966eb21cee4a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:10.692387 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b2a83c93-96de-4f82-9322-966eb21cee4a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:10.693077 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b2a83c93-96de-4f82-9322-966eb21cee4a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:10.850571 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-b2a83c93-96de-4f82-9322-966eb21cee4a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:10.860239 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-b2a83c93-96de-4f82-9322-966eb21cee4a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1523 microversion: 2.1 time: 0.187027 Aug 26 00:55:10.860841 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 110/211] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:10 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:11.268186 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-986cae0d-88a4-495a-b79c-0a2f96f16efd tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1720079978", "imageRef": "ef60327f-6e0c-4f85-8db9-6f6e8968fe9c", "flavorRef": "452", "networks": [{"uuid": "26ae3024-dc7c-4eb7-8ff7-8c6eee8da550"}]}} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:55:11.324125 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.network.neutron [None req-986cae0d-88a4-495a-b79c-0a2f96f16efd tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] validate_networks() for [('26ae3024-dc7c-4eb7-8ff7-8c6eee8da550', None, None, None, None, None)] {{(pid=127565) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 00:55:11.432973 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-90b1cde5-39a4-436c-bec3-fa7c2d4b0ffc tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:11.433805 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-90b1cde5-39a4-436c-bec3-fa7c2d4b0ffc tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] [instance: d778c4bb-8dd8-4106-b7cc-12a1d485cf1e] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:11.441897 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-90b1cde5-39a4-436c-bec3-fa7c2d4b0ffc tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:11.442916 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-90b1cde5-39a4-436c-bec3-fa7c2d4b0ffc tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:11.442916 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-90b1cde5-39a4-436c-bec3-fa7c2d4b0ffc tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:11.443461 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-90b1cde5-39a4-436c-bec3-fa7c2d4b0ffc tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:11.443917 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-90b1cde5-39a4-436c-bec3-fa7c2d4b0ffc tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:11.444314 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-90b1cde5-39a4-436c-bec3-fa7c2d4b0ffc tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:11.493582 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-90b1cde5-39a4-436c-bec3-fa7c2d4b0ffc tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:11.493582 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-90b1cde5-39a4-436c-bec3-fa7c2d4b0ffc tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:11.493582 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-90b1cde5-39a4-436c-bec3-fa7c2d4b0ffc tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:11.493582 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.objects.instance [None req-90b1cde5-39a4-436c-bec3-fa7c2d4b0ffc tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lazy-loading 'fault' on Instance uuid d778c4bb-8dd8-4106-b7cc-12a1d485cf1e {{(pid=127564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 00:55:11.536814 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-90b1cde5-39a4-436c-bec3-fa7c2d4b0ffc tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a425027e59242bba6b05407d19cac82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032ed1b5aea842edb0bcae9d23810786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:11.546243 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-90b1cde5-39a4-436c-bec3-fa7c2d4b0ffc tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] 10.222.0.59 "GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e" status: 200 len: 1350 microversion: 2.1 time: 0.118628 Aug 26 00:55:11.547063 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 111/212] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:11 2022] GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e => generated 1350 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:55:11.780351 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.virt.hardware [None req-986cae0d-88a4-495a-b79c-0a2f96f16efd tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Flavor limits 0:0:0 {{(pid=127565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 00:55:11.780922 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.virt.hardware [None req-986cae0d-88a4-495a-b79c-0a2f96f16efd tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Image limits 0:0:0 {{(pid=127565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 00:55:11.781491 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.virt.hardware [None req-986cae0d-88a4-495a-b79c-0a2f96f16efd tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Flavor pref 0:0:0 {{(pid=127565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 00:55:11.782042 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.virt.hardware [None req-986cae0d-88a4-495a-b79c-0a2f96f16efd tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Image pref 0:0:0 {{(pid=127565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 00:55:11.782837 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.virt.hardware [None req-986cae0d-88a4-495a-b79c-0a2f96f16efd tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 00:55:11.793385 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-986cae0d-88a4-495a-b79c-0a2f96f16efd tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:11.797400 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-986cae0d-88a4-495a-b79c-0a2f96f16efd tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:11.798511 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-986cae0d-88a4-495a-b79c-0a2f96f16efd tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:11.800572 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-986cae0d-88a4-495a-b79c-0a2f96f16efd tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:11.801256 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-986cae0d-88a4-495a-b79c-0a2f96f16efd tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:11.802157 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-986cae0d-88a4-495a-b79c-0a2f96f16efd tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:11.820313 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.quota [None req-986cae0d-88a4-495a-b79c-0a2f96f16efd tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Getting quotas for project 9b49ff217de14a2aae05d524128dec49. Resources: {'instances', 'ram', 'cores'} {{(pid=127565) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 00:55:11.835105 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.quota [None req-986cae0d-88a4-495a-b79c-0a2f96f16efd tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Getting quotas for user 2f93774232c1479aa3e856bffb352140 and project 9b49ff217de14a2aae05d524128dec49. Resources: {'instances', 'ram', 'cores'} {{(pid=127565) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 00:55:11.870175 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-986cae0d-88a4-495a-b79c-0a2f96f16efd tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Going to run 1 instances... {{(pid=127565) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 00:55:11.872573 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-986cae0d-88a4-495a-b79c-0a2f96f16efd tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: 2507d827-8d75-49dd-9b79-351d7a7bb802] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ef60327f-6e0c-4f85-8db9-6f6e8968fe9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127565) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 00:55:11.883058 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-61489ee2-b4f7-4f85-9f0b-6ed469edb9a7 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:11.884325 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-61489ee2-b4f7-4f85-9f0b-6ed469edb9a7 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:11.893229 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_api:SELECT=67 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:55:11.895777 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-61489ee2-b4f7-4f85-9f0b-6ed469edb9a7 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:11.896096 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-61489ee2-b4f7-4f85-9f0b-6ed469edb9a7 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:11.896618 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-61489ee2-b4f7-4f85-9f0b-6ed469edb9a7 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:11.897386 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-61489ee2-b4f7-4f85-9f0b-6ed469edb9a7 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:11.899024 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-61489ee2-b4f7-4f85-9f0b-6ed469edb9a7 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:11.899903 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-61489ee2-b4f7-4f85-9f0b-6ed469edb9a7 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:11.991631 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-986cae0d-88a4-495a-b79c-0a2f96f16efd tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.731732 Aug 26 00:55:11.993125 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 102/213] 10.222.0.59 () {60 vars in 1147 bytes} [Fri Aug 26 00:55:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 00:55:12.007190 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-6baf7bc2-2030-4b55-a1d6-74117520efc3 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:12.007861 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-6baf7bc2-2030-4b55-a1d6-74117520efc3 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: 2507d827-8d75-49dd-9b79-351d7a7bb802] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:12.073792 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-61489ee2-b4f7-4f85-9f0b-6ed469edb9a7 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:12.081395 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-6baf7bc2-2030-4b55-a1d6-74117520efc3 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93774232c1479aa3e856bffb352140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b49ff217de14a2aae05d524128dec49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:12.087101 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-61489ee2-b4f7-4f85-9f0b-6ed469edb9a7 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1523 microversion: 2.1 time: 0.208926 Aug 26 00:55:12.101515 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 112/214] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:11 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1523 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:55:12.101875 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-6baf7bc2-2030-4b55-a1d6-74117520efc3 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] 10.222.0.59 "GET /compute/v2.1/servers/2507d827-8d75-49dd-9b79-351d7a7bb802" status: 200 len: 1214 microversion: 2.1 time: 0.090773 Aug 26 00:55:12.101875 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 103/215] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:11 2022] GET /compute/v2.1/servers/2507d827-8d75-49dd-9b79-351d7a7bb802 => generated 1214 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:55:12.572014 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-a190f7ca-0843-44ec-b2c1-bf051260c24c tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:12.572014 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-a190f7ca-0843-44ec-b2c1-bf051260c24c tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] [instance: d778c4bb-8dd8-4106-b7cc-12a1d485cf1e] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:12.575134 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a190f7ca-0843-44ec-b2c1-bf051260c24c tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:12.575816 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a190f7ca-0843-44ec-b2c1-bf051260c24c tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:12.576261 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a190f7ca-0843-44ec-b2c1-bf051260c24c tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:12.577010 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a190f7ca-0843-44ec-b2c1-bf051260c24c tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:12.577474 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a190f7ca-0843-44ec-b2c1-bf051260c24c tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:12.577902 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a190f7ca-0843-44ec-b2c1-bf051260c24c tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:12.592730 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.wsgi [None req-a190f7ca-0843-44ec-b2c1-bf051260c24c tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] HTTP exception thrown: Instance d778c4bb-8dd8-4106-b7cc-12a1d485cf1e could not be found. Aug 26 00:55:12.601755 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-a190f7ca-0843-44ec-b2c1-bf051260c24c tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Request method failure captured: Aug 26 00:55:12.601755 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: request: GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e HTTP/1.1 Aug 26 00:55:12.601755 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Accept: application/json Aug 26 00:55:12.601755 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Accept-Encoding: identity Aug 26 00:55:12.601755 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Connection: close Aug 26 00:55:12.601755 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Content-Length: 0 Aug 26 00:55:12.601755 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Content-Type: application/json Aug 26 00:55:12.601755 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Host: 10.222.0.59 Aug 26 00:55:12.601755 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Openstack-System-Scope: None Aug 26 00:55:12.601755 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: User-Agent: python-urllib3/1.26.11 Aug 26 00:55:12.601755 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Auth-Token: gAAAAABjCBmfmQakZwBkaypTMB7Rqo8IWkcwlWQrceVk1iItmp4n1iKSy7JBr1VLm4084J4lmjH0bYKxB291P7fWwfoS-930hQSHlvCSaGB90ZgxMxHvDJdqYSbLNKYgwWw-m4L9Ajz0UF7ZBWR6yr0tKzdSjG_YlJmifQMCjJI6anpF9Jceboo Aug 26 00:55:12.601755 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Domain-Id: None Aug 26 00:55:12.601755 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Domain-Name: None Aug 26 00:55:12.601755 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Identity-Status: Confirmed Aug 26 00:55:12.601755 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Is-Admin-Project: True Aug 26 00:55:12.601755 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Domain-Id: default Aug 26 00:55:12.601755 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Domain-Name: Default Aug 26 00:55:12.601755 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Id: 032ed1b5aea842edb0bcae9d23810786 Aug 26 00:55:12.601755 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Name: tempest-DeleteServersTestJSON-176130416 Aug 26 00:55:12.601755 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Role: reader,member Aug 26 00:55:12.601755 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Roles: reader,member Aug 26 00:55:12.603006 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_032ed1b5aea842edb0bcae9d23810786"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/032ed1b5aea842edb0bcae9d23810786"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/032ed1b5aea842edb0bcae9d23810786"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/032ed1b5aea842edb0bcae9d23810786"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 00:55:12.603006 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant: tempest-DeleteServersTestJSON-176130416 Aug 26 00:55:12.603006 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant-Id: 032ed1b5aea842edb0bcae9d23810786 Aug 26 00:55:12.603006 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant-Name: tempest-DeleteServersTestJSON-176130416 Aug 26 00:55:12.603006 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User: tempest-DeleteServersTestJSON-176130416-project Aug 26 00:55:12.603006 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Domain-Id: default Aug 26 00:55:12.603006 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Domain-Name: Default Aug 26 00:55:12.603006 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Id: 1a425027e59242bba6b05407d19cac82 Aug 26 00:55:12.603006 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Name: tempest-DeleteServersTestJSON-176130416-project Aug 26 00:55:12.603006 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: method: > Aug 26 00:55:12.603006 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: exception: Instance d778c4bb-8dd8-4106-b7cc-12a1d485cf1e could not be found. Aug 26 00:55:12.603006 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: action_args: {'id': 'd778c4bb-8dd8-4106-b7cc-12a1d485cf1e'} Aug 26 00:55:12.603764 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 00:55:12.603764 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:55:12.603764 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 00:55:12.603764 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 00:55:12.603764 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 00:55:12.603764 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 00:55:12.603764 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 00:55:12.603764 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 00:55:12.603764 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 00:55:12.603764 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 00:55:12.603764 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d778c4bb-8dd8-4106-b7cc-12a1d485cf1e could not be found. Aug 26 00:55:12.603764 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 00:55:12.603764 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 00:55:12.603764 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 00:55:12.603764 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:55:12.603764 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 00:55:12.603764 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 00:55:12.603764 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 00:55:12.603764 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 00:55:12.603764 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 00:55:12.605525 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 00:55:12.605525 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 00:55:12.605525 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 00:55:12.605525 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 00:55:12.605525 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 00:55:12.605525 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 00:55:12.605525 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 00:55:12.605525 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d778c4bb-8dd8-4106-b7cc-12a1d485cf1e could not be found. Aug 26 00:55:12.605525 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 00:55:12.605525 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 00:55:12.605525 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 00:55:12.605525 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:55:12.605525 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 00:55:12.605525 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 00:55:12.605525 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 00:55:12.605525 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 00:55:12.605525 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d778c4bb-8dd8-4106-b7cc-12a1d485cf1e could not be found. Aug 26 00:55:12.605525 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 00:55:12.606988 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-a190f7ca-0843-44ec-b2c1-bf051260c24c tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Returning 404 to user: Instance d778c4bb-8dd8-4106-b7cc-12a1d485cf1e could not be found. {{(pid=127564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 00:55:12.606988 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-a190f7ca-0843-44ec-b2c1-bf051260c24c tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] 10.222.0.59 "GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e" status: 404 len: 111 microversion: 2.1 time: 0.040171 Aug 26 00:55:12.606988 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 113/216] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:12 2022] GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 00:55:12.723268 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-8744be48-8b3e-479b-96e6-cfed03a5a076 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:12.725611 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-8744be48-8b3e-479b-96e6-cfed03a5a076 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] [instance: d778c4bb-8dd8-4106-b7cc-12a1d485cf1e] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:12.732007 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8744be48-8b3e-479b-96e6-cfed03a5a076 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:12.732530 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8744be48-8b3e-479b-96e6-cfed03a5a076 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:12.732964 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8744be48-8b3e-479b-96e6-cfed03a5a076 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:12.733635 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8744be48-8b3e-479b-96e6-cfed03a5a076 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:12.734079 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8744be48-8b3e-479b-96e6-cfed03a5a076 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:12.734496 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8744be48-8b3e-479b-96e6-cfed03a5a076 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:12.747488 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.wsgi [None req-8744be48-8b3e-479b-96e6-cfed03a5a076 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] HTTP exception thrown: Instance d778c4bb-8dd8-4106-b7cc-12a1d485cf1e could not be found. Aug 26 00:55:12.751488 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-8744be48-8b3e-479b-96e6-cfed03a5a076 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Request method failure captured: Aug 26 00:55:12.751488 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: request: GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e/os-volume_attachments HTTP/1.1 Aug 26 00:55:12.751488 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Accept: application/json Aug 26 00:55:12.751488 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Accept-Encoding: identity Aug 26 00:55:12.751488 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Connection: close Aug 26 00:55:12.751488 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Content-Length: 0 Aug 26 00:55:12.751488 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Content-Type: application/json Aug 26 00:55:12.751488 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Host: 10.222.0.59 Aug 26 00:55:12.751488 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Openstack-System-Scope: None Aug 26 00:55:12.751488 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: User-Agent: python-urllib3/1.26.11 Aug 26 00:55:12.751488 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Auth-Token: gAAAAABjCBmfmQakZwBkaypTMB7Rqo8IWkcwlWQrceVk1iItmp4n1iKSy7JBr1VLm4084J4lmjH0bYKxB291P7fWwfoS-930hQSHlvCSaGB90ZgxMxHvDJdqYSbLNKYgwWw-m4L9Ajz0UF7ZBWR6yr0tKzdSjG_YlJmifQMCjJI6anpF9Jceboo Aug 26 00:55:12.751488 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Domain-Id: None Aug 26 00:55:12.751488 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Domain-Name: None Aug 26 00:55:12.751488 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Identity-Status: Confirmed Aug 26 00:55:12.751488 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Is-Admin-Project: True Aug 26 00:55:12.751488 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Domain-Id: default Aug 26 00:55:12.751488 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Domain-Name: Default Aug 26 00:55:12.751488 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Id: 032ed1b5aea842edb0bcae9d23810786 Aug 26 00:55:12.751488 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Name: tempest-DeleteServersTestJSON-176130416 Aug 26 00:55:12.751488 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Role: reader,member Aug 26 00:55:12.751488 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Roles: reader,member Aug 26 00:55:12.753011 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_032ed1b5aea842edb0bcae9d23810786"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/032ed1b5aea842edb0bcae9d23810786"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/032ed1b5aea842edb0bcae9d23810786"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/032ed1b5aea842edb0bcae9d23810786"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 00:55:12.753011 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant: tempest-DeleteServersTestJSON-176130416 Aug 26 00:55:12.753011 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant-Id: 032ed1b5aea842edb0bcae9d23810786 Aug 26 00:55:12.753011 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant-Name: tempest-DeleteServersTestJSON-176130416 Aug 26 00:55:12.753011 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User: tempest-DeleteServersTestJSON-176130416-project Aug 26 00:55:12.753011 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Domain-Id: default Aug 26 00:55:12.753011 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Domain-Name: Default Aug 26 00:55:12.753011 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Id: 1a425027e59242bba6b05407d19cac82 Aug 26 00:55:12.753011 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Name: tempest-DeleteServersTestJSON-176130416-project Aug 26 00:55:12.753011 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: method: > Aug 26 00:55:12.753011 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: exception: Instance d778c4bb-8dd8-4106-b7cc-12a1d485cf1e could not be found. Aug 26 00:55:12.753011 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: action_args: {'server_id': 'd778c4bb-8dd8-4106-b7cc-12a1d485cf1e'} Aug 26 00:55:12.754425 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 00:55:12.754425 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:55:12.754425 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 00:55:12.754425 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 00:55:12.754425 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 00:55:12.754425 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 00:55:12.754425 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 00:55:12.754425 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 00:55:12.754425 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 00:55:12.754425 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 00:55:12.754425 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d778c4bb-8dd8-4106-b7cc-12a1d485cf1e could not be found. Aug 26 00:55:12.754425 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:55:12.754425 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 00:55:12.754425 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:55:12.754425 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:55:12.754425 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 00:55:12.754425 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 00:55:12.754425 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 00:55:12.754425 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 00:55:12.754425 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 00:55:12.755787 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 00:55:12.755787 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 26 00:55:12.755787 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 00:55:12.755787 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 26 00:55:12.755787 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 00:55:12.755787 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 26 00:55:12.755787 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 26 00:55:12.755787 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 00:55:12.755787 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 00:55:12.755787 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d778c4bb-8dd8-4106-b7cc-12a1d485cf1e could not be found. Aug 26 00:55:12.755787 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:55:12.755787 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 00:55:12.755787 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:55:12.755787 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:55:12.755787 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 00:55:12.755787 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 00:55:12.755787 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 00:55:12.755787 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 00:55:12.755787 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d778c4bb-8dd8-4106-b7cc-12a1d485cf1e could not be found. Aug 26 00:55:12.755787 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:55:12.757452 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-8744be48-8b3e-479b-96e6-cfed03a5a076 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Returning 404 to user: Instance d778c4bb-8dd8-4106-b7cc-12a1d485cf1e could not be found. {{(pid=127565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 00:55:12.757452 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-8744be48-8b3e-479b-96e6-cfed03a5a076 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] 10.222.0.59 "GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034614 Aug 26 00:55:12.757452 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 104/217] 10.222.0.59 () {58 vars in 1302 bytes} [Fri Aug 26 00:55:12 2022] GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 00:55:13.109141 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-30ea97a8-c711-4d91-b85c-6aafb3aa8574 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:13.109834 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-30ea97a8-c711-4d91-b85c-6aafb3aa8574 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:13.111211 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-efea52c8-1041-4ad2-90c1-f34c0d931300 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:13.112201 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-efea52c8-1041-4ad2-90c1-f34c0d931300 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: 2507d827-8d75-49dd-9b79-351d7a7bb802] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:13.116382 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-30ea97a8-c711-4d91-b85c-6aafb3aa8574 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:13.116997 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-30ea97a8-c711-4d91-b85c-6aafb3aa8574 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:13.117492 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-30ea97a8-c711-4d91-b85c-6aafb3aa8574 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:13.118465 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-30ea97a8-c711-4d91-b85c-6aafb3aa8574 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:13.128203 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-30ea97a8-c711-4d91-b85c-6aafb3aa8574 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:13.129651 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-30ea97a8-c711-4d91-b85c-6aafb3aa8574 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:13.167967 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-efea52c8-1041-4ad2-90c1-f34c0d931300 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93774232c1479aa3e856bffb352140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b49ff217de14a2aae05d524128dec49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:13.176694 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-efea52c8-1041-4ad2-90c1-f34c0d931300 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] 10.222.0.59 "GET /compute/v2.1/servers/2507d827-8d75-49dd-9b79-351d7a7bb802" status: 200 len: 1214 microversion: 2.1 time: 0.069186 Aug 26 00:55:13.180742 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 105/218] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:13 2022] GET /compute/v2.1/servers/2507d827-8d75-49dd-9b79-351d7a7bb802 => generated 1214 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:55:13.294031 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-30ea97a8-c711-4d91-b85c-6aafb3aa8574 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:13.306929 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-30ea97a8-c711-4d91-b85c-6aafb3aa8574 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1523 microversion: 2.1 time: 0.199173 Aug 26 00:55:13.306929 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 114/219] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:13 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1523 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:14.099057 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-7dab1ee4-29f3-4030-954b-e7866e6be960 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:14.099771 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-7dab1ee4-29f3-4030-954b-e7866e6be960 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] [instance: d778c4bb-8dd8-4106-b7cc-12a1d485cf1e] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:14.107171 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7dab1ee4-29f3-4030-954b-e7866e6be960 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:14.107664 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7dab1ee4-29f3-4030-954b-e7866e6be960 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:14.108151 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7dab1ee4-29f3-4030-954b-e7866e6be960 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:14.108905 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7dab1ee4-29f3-4030-954b-e7866e6be960 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:14.109520 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7dab1ee4-29f3-4030-954b-e7866e6be960 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:14.110636 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7dab1ee4-29f3-4030-954b-e7866e6be960 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:14.125699 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.wsgi [None req-7dab1ee4-29f3-4030-954b-e7866e6be960 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] HTTP exception thrown: Instance d778c4bb-8dd8-4106-b7cc-12a1d485cf1e could not be found. Aug 26 00:55:14.129246 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-7dab1ee4-29f3-4030-954b-e7866e6be960 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Request method failure captured: Aug 26 00:55:14.129246 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: request: DELETE /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e HTTP/1.1 Aug 26 00:55:14.129246 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Accept: application/json Aug 26 00:55:14.129246 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Accept-Encoding: identity Aug 26 00:55:14.129246 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Connection: close Aug 26 00:55:14.129246 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Content-Length: 0 Aug 26 00:55:14.129246 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Content-Type: application/json Aug 26 00:55:14.129246 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Host: 10.222.0.59 Aug 26 00:55:14.129246 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Openstack-System-Scope: None Aug 26 00:55:14.129246 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: User-Agent: python-urllib3/1.26.11 Aug 26 00:55:14.129246 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Auth-Token: gAAAAABjCBmfmQakZwBkaypTMB7Rqo8IWkcwlWQrceVk1iItmp4n1iKSy7JBr1VLm4084J4lmjH0bYKxB291P7fWwfoS-930hQSHlvCSaGB90ZgxMxHvDJdqYSbLNKYgwWw-m4L9Ajz0UF7ZBWR6yr0tKzdSjG_YlJmifQMCjJI6anpF9Jceboo Aug 26 00:55:14.129246 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Domain-Id: None Aug 26 00:55:14.129246 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Domain-Name: None Aug 26 00:55:14.129246 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Identity-Status: Confirmed Aug 26 00:55:14.129246 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Is-Admin-Project: True Aug 26 00:55:14.129246 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Domain-Id: default Aug 26 00:55:14.129246 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Domain-Name: Default Aug 26 00:55:14.129246 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Id: 032ed1b5aea842edb0bcae9d23810786 Aug 26 00:55:14.129246 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Name: tempest-DeleteServersTestJSON-176130416 Aug 26 00:55:14.129246 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Role: reader,member Aug 26 00:55:14.129246 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Roles: reader,member Aug 26 00:55:14.135498 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_032ed1b5aea842edb0bcae9d23810786"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/032ed1b5aea842edb0bcae9d23810786"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/032ed1b5aea842edb0bcae9d23810786"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/032ed1b5aea842edb0bcae9d23810786"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 00:55:14.135498 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant: tempest-DeleteServersTestJSON-176130416 Aug 26 00:55:14.135498 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant-Id: 032ed1b5aea842edb0bcae9d23810786 Aug 26 00:55:14.135498 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant-Name: tempest-DeleteServersTestJSON-176130416 Aug 26 00:55:14.135498 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User: tempest-DeleteServersTestJSON-176130416-project Aug 26 00:55:14.135498 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Domain-Id: default Aug 26 00:55:14.135498 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Domain-Name: Default Aug 26 00:55:14.135498 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Id: 1a425027e59242bba6b05407d19cac82 Aug 26 00:55:14.135498 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Name: tempest-DeleteServersTestJSON-176130416-project Aug 26 00:55:14.135498 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: method: > Aug 26 00:55:14.135498 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: exception: Instance d778c4bb-8dd8-4106-b7cc-12a1d485cf1e could not be found. Aug 26 00:55:14.135498 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: action_args: {'id': 'd778c4bb-8dd8-4106-b7cc-12a1d485cf1e'} Aug 26 00:55:14.136314 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 00:55:14.136314 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:55:14.136314 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 00:55:14.136314 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 00:55:14.136314 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 00:55:14.136314 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 00:55:14.136314 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 00:55:14.136314 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 00:55:14.136314 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 00:55:14.136314 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 00:55:14.136314 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d778c4bb-8dd8-4106-b7cc-12a1d485cf1e could not be found. Aug 26 00:55:14.136314 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:55:14.136314 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 00:55:14.136314 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:55:14.136314 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:55:14.136314 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 00:55:14.136314 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 00:55:14.136314 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 00:55:14.136314 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 00:55:14.136314 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 00:55:14.137555 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 00:55:14.137555 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 00:55:14.137555 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 00:55:14.137555 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 00:55:14.137555 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 00:55:14.137555 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 00:55:14.137555 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 00:55:14.137555 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 00:55:14.137555 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 00:55:14.137555 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d778c4bb-8dd8-4106-b7cc-12a1d485cf1e could not be found. Aug 26 00:55:14.137555 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:55:14.137555 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 00:55:14.137555 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:55:14.137555 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:55:14.137555 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 00:55:14.137555 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 00:55:14.137555 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 00:55:14.137555 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 00:55:14.137555 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d778c4bb-8dd8-4106-b7cc-12a1d485cf1e could not be found. Aug 26 00:55:14.137555 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:55:14.138683 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-7dab1ee4-29f3-4030-954b-e7866e6be960 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Returning 404 to user: Instance d778c4bb-8dd8-4106-b7cc-12a1d485cf1e could not be found. {{(pid=127565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 00:55:14.138683 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-7dab1ee4-29f3-4030-954b-e7866e6be960 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] 10.222.0.59 "DELETE /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e" status: 404 len: 111 microversion: 2.1 time: 0.036182 Aug 26 00:55:14.138683 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 106/220] 10.222.0.59 () {58 vars in 1239 bytes} [Fri Aug 26 00:55:14 2022] DELETE /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 00:55:14.140785 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-bbfc945d-31db-4732-8a27-564ca59098c5 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:14.141448 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-bbfc945d-31db-4732-8a27-564ca59098c5 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] [instance: d778c4bb-8dd8-4106-b7cc-12a1d485cf1e] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:14.149338 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bbfc945d-31db-4732-8a27-564ca59098c5 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:14.150045 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bbfc945d-31db-4732-8a27-564ca59098c5 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:14.150470 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bbfc945d-31db-4732-8a27-564ca59098c5 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:14.151167 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bbfc945d-31db-4732-8a27-564ca59098c5 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:14.151619 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bbfc945d-31db-4732-8a27-564ca59098c5 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:14.152300 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bbfc945d-31db-4732-8a27-564ca59098c5 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:14.169583 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.wsgi [None req-bbfc945d-31db-4732-8a27-564ca59098c5 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] HTTP exception thrown: Instance d778c4bb-8dd8-4106-b7cc-12a1d485cf1e could not be found. Aug 26 00:55:14.170848 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-bbfc945d-31db-4732-8a27-564ca59098c5 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Request method failure captured: Aug 26 00:55:14.170848 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: request: GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e HTTP/1.1 Aug 26 00:55:14.170848 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Accept: application/json Aug 26 00:55:14.170848 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Accept-Encoding: identity Aug 26 00:55:14.170848 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Connection: close Aug 26 00:55:14.170848 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Content-Length: 0 Aug 26 00:55:14.170848 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Content-Type: application/json Aug 26 00:55:14.170848 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Host: 10.222.0.59 Aug 26 00:55:14.170848 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Openstack-System-Scope: None Aug 26 00:55:14.170848 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: User-Agent: python-urllib3/1.26.11 Aug 26 00:55:14.170848 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Auth-Token: gAAAAABjCBmfmQakZwBkaypTMB7Rqo8IWkcwlWQrceVk1iItmp4n1iKSy7JBr1VLm4084J4lmjH0bYKxB291P7fWwfoS-930hQSHlvCSaGB90ZgxMxHvDJdqYSbLNKYgwWw-m4L9Ajz0UF7ZBWR6yr0tKzdSjG_YlJmifQMCjJI6anpF9Jceboo Aug 26 00:55:14.170848 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Domain-Id: None Aug 26 00:55:14.170848 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Domain-Name: None Aug 26 00:55:14.170848 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Identity-Status: Confirmed Aug 26 00:55:14.170848 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Is-Admin-Project: True Aug 26 00:55:14.170848 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Domain-Id: default Aug 26 00:55:14.170848 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Domain-Name: Default Aug 26 00:55:14.170848 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Id: 032ed1b5aea842edb0bcae9d23810786 Aug 26 00:55:14.170848 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Name: tempest-DeleteServersTestJSON-176130416 Aug 26 00:55:14.170848 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Role: reader,member Aug 26 00:55:14.170848 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Roles: reader,member Aug 26 00:55:14.172277 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_032ed1b5aea842edb0bcae9d23810786"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/032ed1b5aea842edb0bcae9d23810786"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/032ed1b5aea842edb0bcae9d23810786"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/032ed1b5aea842edb0bcae9d23810786"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 00:55:14.172277 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant: tempest-DeleteServersTestJSON-176130416 Aug 26 00:55:14.172277 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant-Id: 032ed1b5aea842edb0bcae9d23810786 Aug 26 00:55:14.172277 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant-Name: tempest-DeleteServersTestJSON-176130416 Aug 26 00:55:14.172277 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User: tempest-DeleteServersTestJSON-176130416-project Aug 26 00:55:14.172277 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Domain-Id: default Aug 26 00:55:14.172277 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Domain-Name: Default Aug 26 00:55:14.172277 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Id: 1a425027e59242bba6b05407d19cac82 Aug 26 00:55:14.172277 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Name: tempest-DeleteServersTestJSON-176130416-project Aug 26 00:55:14.172277 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: method: > Aug 26 00:55:14.172277 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: exception: Instance d778c4bb-8dd8-4106-b7cc-12a1d485cf1e could not be found. Aug 26 00:55:14.172277 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: action_args: {'id': 'd778c4bb-8dd8-4106-b7cc-12a1d485cf1e'} Aug 26 00:55:14.173021 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 00:55:14.173021 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:55:14.173021 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 00:55:14.173021 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 00:55:14.173021 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 00:55:14.173021 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 00:55:14.173021 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 00:55:14.173021 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 00:55:14.173021 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 00:55:14.173021 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 00:55:14.173021 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d778c4bb-8dd8-4106-b7cc-12a1d485cf1e could not be found. Aug 26 00:55:14.173021 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 00:55:14.173021 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 00:55:14.173021 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 00:55:14.173021 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:55:14.173021 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 00:55:14.173021 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 00:55:14.173021 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 00:55:14.173021 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 00:55:14.173021 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 00:55:14.174092 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 00:55:14.174092 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 00:55:14.174092 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 00:55:14.174092 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 00:55:14.174092 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 00:55:14.174092 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 00:55:14.174092 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 00:55:14.174092 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d778c4bb-8dd8-4106-b7cc-12a1d485cf1e could not be found. Aug 26 00:55:14.174092 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 00:55:14.174092 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 00:55:14.174092 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 00:55:14.174092 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:55:14.174092 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 00:55:14.174092 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 00:55:14.174092 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 00:55:14.174092 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 00:55:14.174092 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d778c4bb-8dd8-4106-b7cc-12a1d485cf1e could not be found. Aug 26 00:55:14.174092 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 00:55:14.175074 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-bbfc945d-31db-4732-8a27-564ca59098c5 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] Returning 404 to user: Instance d778c4bb-8dd8-4106-b7cc-12a1d485cf1e could not be found. {{(pid=127564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 00:55:14.175074 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-bbfc945d-31db-4732-8a27-564ca59098c5 tempest-DeleteServersTestJSON-176130416 tempest-DeleteServersTestJSON-176130416-project] 10.222.0.59 "GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e" status: 404 len: 111 microversion: 2.1 time: 0.036519 Aug 26 00:55:14.175074 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 115/221] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:14 2022] GET /compute/v2.1/servers/d778c4bb-8dd8-4106-b7cc-12a1d485cf1e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 00:55:14.200877 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-be193f7e-a83e-4b73-a13d-295a7a6c548e tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:14.201506 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-be193f7e-a83e-4b73-a13d-295a7a6c548e tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: 2507d827-8d75-49dd-9b79-351d7a7bb802] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:14.209129 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-be193f7e-a83e-4b73-a13d-295a7a6c548e tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:14.209816 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-be193f7e-a83e-4b73-a13d-295a7a6c548e tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:14.216275 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-be193f7e-a83e-4b73-a13d-295a7a6c548e tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:14.216275 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-be193f7e-a83e-4b73-a13d-295a7a6c548e tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:14.216275 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-be193f7e-a83e-4b73-a13d-295a7a6c548e tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:14.216275 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-be193f7e-a83e-4b73-a13d-295a7a6c548e tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:14.305694 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-be193f7e-a83e-4b73-a13d-295a7a6c548e tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93774232c1479aa3e856bffb352140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b49ff217de14a2aae05d524128dec49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:14.316807 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-be193f7e-a83e-4b73-a13d-295a7a6c548e tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] 10.222.0.59 "GET /compute/v2.1/servers/2507d827-8d75-49dd-9b79-351d7a7bb802" status: 200 len: 1266 microversion: 2.1 time: 0.119317 Aug 26 00:55:14.317661 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 107/222] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:14 2022] GET /compute/v2.1/servers/2507d827-8d75-49dd-9b79-351d7a7bb802 => generated 1266 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:14.329296 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-7156eccf-8e6a-4f32-a0fe-c4a9a56541a0 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:14.329296 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-7156eccf-8e6a-4f32-a0fe-c4a9a56541a0 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:14.336739 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-7156eccf-8e6a-4f32-a0fe-c4a9a56541a0 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:14.337180 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-7156eccf-8e6a-4f32-a0fe-c4a9a56541a0 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:14.337624 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-7156eccf-8e6a-4f32-a0fe-c4a9a56541a0 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:14.338323 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-7156eccf-8e6a-4f32-a0fe-c4a9a56541a0 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:14.338812 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-7156eccf-8e6a-4f32-a0fe-c4a9a56541a0 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:14.339464 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-7156eccf-8e6a-4f32-a0fe-c4a9a56541a0 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:14.606724 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-7156eccf-8e6a-4f32-a0fe-c4a9a56541a0 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:14.616065 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-7156eccf-8e6a-4f32-a0fe-c4a9a56541a0 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1523 microversion: 2.1 time: 0.293468 Aug 26 00:55:14.617590 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 116/223] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:14 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1523 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:55:15.339270 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-ae89f448-7209-4dc6-90c0-bbbf42b0f3bf tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:15.339876 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-ae89f448-7209-4dc6-90c0-bbbf42b0f3bf tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: 2507d827-8d75-49dd-9b79-351d7a7bb802] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:15.347061 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ae89f448-7209-4dc6-90c0-bbbf42b0f3bf tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:15.347557 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ae89f448-7209-4dc6-90c0-bbbf42b0f3bf tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:15.348003 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ae89f448-7209-4dc6-90c0-bbbf42b0f3bf tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:15.348958 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ae89f448-7209-4dc6-90c0-bbbf42b0f3bf tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:15.349571 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ae89f448-7209-4dc6-90c0-bbbf42b0f3bf tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:15.349810 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ae89f448-7209-4dc6-90c0-bbbf42b0f3bf tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:15.421124 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-ae89f448-7209-4dc6-90c0-bbbf42b0f3bf tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93774232c1479aa3e856bffb352140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b49ff217de14a2aae05d524128dec49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:15.429486 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-ae89f448-7209-4dc6-90c0-bbbf42b0f3bf tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] 10.222.0.59 "GET /compute/v2.1/servers/2507d827-8d75-49dd-9b79-351d7a7bb802" status: 200 len: 1272 microversion: 2.1 time: 0.094933 Aug 26 00:55:15.430124 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 108/224] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:15 2022] GET /compute/v2.1/servers/2507d827-8d75-49dd-9b79-351d7a7bb802 => generated 1272 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:15.638220 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-34029089-e9e2-48d4-af41-5a80e16c323c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:15.638831 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-34029089-e9e2-48d4-af41-5a80e16c323c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:15.644950 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-34029089-e9e2-48d4-af41-5a80e16c323c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:15.645437 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-34029089-e9e2-48d4-af41-5a80e16c323c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:15.646019 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-34029089-e9e2-48d4-af41-5a80e16c323c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:15.646717 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-34029089-e9e2-48d4-af41-5a80e16c323c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:15.647166 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-34029089-e9e2-48d4-af41-5a80e16c323c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:15.647596 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-34029089-e9e2-48d4-af41-5a80e16c323c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:16.204889 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-34029089-e9e2-48d4-af41-5a80e16c323c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:16.214528 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-34029089-e9e2-48d4-af41-5a80e16c323c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1523 microversion: 2.1 time: 0.580408 Aug 26 00:55:16.230150 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 117/225] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:15 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1523 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:16.451173 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-f15fac8d-cfb4-4ee9-b27b-a159c17fc997 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:16.452969 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-f15fac8d-cfb4-4ee9-b27b-a159c17fc997 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: 2507d827-8d75-49dd-9b79-351d7a7bb802] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:16.460699 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f15fac8d-cfb4-4ee9-b27b-a159c17fc997 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:16.461391 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f15fac8d-cfb4-4ee9-b27b-a159c17fc997 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:16.462950 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f15fac8d-cfb4-4ee9-b27b-a159c17fc997 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:16.462950 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f15fac8d-cfb4-4ee9-b27b-a159c17fc997 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:16.463784 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f15fac8d-cfb4-4ee9-b27b-a159c17fc997 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:16.463982 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f15fac8d-cfb4-4ee9-b27b-a159c17fc997 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:16.651967 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-f15fac8d-cfb4-4ee9-b27b-a159c17fc997 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93774232c1479aa3e856bffb352140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b49ff217de14a2aae05d524128dec49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:16.662528 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-f15fac8d-cfb4-4ee9-b27b-a159c17fc997 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] 10.222.0.59 "GET /compute/v2.1/servers/2507d827-8d75-49dd-9b79-351d7a7bb802" status: 200 len: 1314 microversion: 2.1 time: 0.213118 Aug 26 00:55:16.662528 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 109/226] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:16 2022] GET /compute/v2.1/servers/2507d827-8d75-49dd-9b79-351d7a7bb802 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:17.238164 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-f5c38db9-993f-49c5-8262-58e880c089a2 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:17.238839 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-f5c38db9-993f-49c5-8262-58e880c089a2 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:17.251168 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f5c38db9-993f-49c5-8262-58e880c089a2 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:17.251810 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f5c38db9-993f-49c5-8262-58e880c089a2 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:17.252260 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f5c38db9-993f-49c5-8262-58e880c089a2 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:17.253024 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f5c38db9-993f-49c5-8262-58e880c089a2 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:17.257730 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f5c38db9-993f-49c5-8262-58e880c089a2 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:17.258222 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f5c38db9-993f-49c5-8262-58e880c089a2 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:17.292444 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell1:SELECT=100 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:55:17.527153 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-f5c38db9-993f-49c5-8262-58e880c089a2 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:17.535496 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-f5c38db9-993f-49c5-8262-58e880c089a2 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1523 microversion: 2.1 time: 0.301597 Aug 26 00:55:17.536670 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 118/227] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:17 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1523 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:17.665340 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [req-fe475a0a-f576-4f60-8055-6a66a35fa4bf req-e1081b83-9626-446e-b8ff-0cbdff36e5b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2507d827-8d75-49dd-9b79-351d7a7bb802", "tag": "c5ac9a09-0d7c-4533-8c40-8f7bb360d0fe"}]} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:55:17.670793 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:55:17.681780 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-16659590-d67b-4f6e-9c8e-0be329409d5f tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:17.682392 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-16659590-d67b-4f6e-9c8e-0be329409d5f tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: 2507d827-8d75-49dd-9b79-351d7a7bb802] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:17.685722 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-fe475a0a-f576-4f60-8055-6a66a35fa4bf req-e1081b83-9626-446e-b8ff-0cbdff36e5b9 service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:17.686333 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-fe475a0a-f576-4f60-8055-6a66a35fa4bf req-e1081b83-9626-446e-b8ff-0cbdff36e5b9 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:17.686776 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-fe475a0a-f576-4f60-8055-6a66a35fa4bf req-e1081b83-9626-446e-b8ff-0cbdff36e5b9 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:17.695026 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-16659590-d67b-4f6e-9c8e-0be329409d5f tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:17.695568 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-16659590-d67b-4f6e-9c8e-0be329409d5f tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:17.696006 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-16659590-d67b-4f6e-9c8e-0be329409d5f tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:17.696732 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-16659590-d67b-4f6e-9c8e-0be329409d5f tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:17.697186 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-16659590-d67b-4f6e-9c8e-0be329409d5f tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:17.697611 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-16659590-d67b-4f6e-9c8e-0be329409d5f tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:17.709490 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.compute.server_external_events [req-fe475a0a-f576-4f60-8055-6a66a35fa4bf req-e1081b83-9626-446e-b8ff-0cbdff36e5b9 service nova] Creating event network-changed:c5ac9a09-0d7c-4533-8c40-8f7bb360d0fe for instance 2507d827-8d75-49dd-9b79-351d7a7bb802 on hv-cinder-83538 Aug 26 00:55:17.722680 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [req-fe475a0a-f576-4f60-8055-6a66a35fa4bf req-e1081b83-9626-446e-b8ff-0cbdff36e5b9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061126 Aug 26 00:55:17.725317 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 110/228] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 00:55:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:55:18.137509 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-16659590-d67b-4f6e-9c8e-0be329409d5f tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93774232c1479aa3e856bffb352140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b49ff217de14a2aae05d524128dec49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:18.147176 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-16659590-d67b-4f6e-9c8e-0be329409d5f tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] 10.222.0.59 "GET /compute/v2.1/servers/2507d827-8d75-49dd-9b79-351d7a7bb802" status: 200 len: 1314 microversion: 2.1 time: 0.469193 Aug 26 00:55:18.148027 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 119/229] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:17 2022] GET /compute/v2.1/servers/2507d827-8d75-49dd-9b79-351d7a7bb802 => generated 1314 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:18.557961 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-5ceecaf1-59c3-41c7-92d4-f61633dd220b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:18.558894 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-5ceecaf1-59c3-41c7-92d4-f61633dd220b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:18.569491 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5ceecaf1-59c3-41c7-92d4-f61633dd220b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:18.570288 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5ceecaf1-59c3-41c7-92d4-f61633dd220b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:18.570879 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5ceecaf1-59c3-41c7-92d4-f61633dd220b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:18.571654 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5ceecaf1-59c3-41c7-92d4-f61633dd220b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:18.572816 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5ceecaf1-59c3-41c7-92d4-f61633dd220b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:18.574162 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5ceecaf1-59c3-41c7-92d4-f61633dd220b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:18.907665 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-5ceecaf1-59c3-41c7-92d4-f61633dd220b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:18.916521 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-5ceecaf1-59c3-41c7-92d4-f61633dd220b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1523 microversion: 2.1 time: 0.363209 Aug 26 00:55:18.917295 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 111/230] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:18 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1523 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:19.173571 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-ed55317d-7081-4482-b8a9-5647695f323d tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:19.176507 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-ed55317d-7081-4482-b8a9-5647695f323d tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: 2507d827-8d75-49dd-9b79-351d7a7bb802] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:19.205602 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ed55317d-7081-4482-b8a9-5647695f323d tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:19.206129 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ed55317d-7081-4482-b8a9-5647695f323d tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:19.215328 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ed55317d-7081-4482-b8a9-5647695f323d tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:19.216332 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ed55317d-7081-4482-b8a9-5647695f323d tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:19.217318 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ed55317d-7081-4482-b8a9-5647695f323d tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:19.217923 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ed55317d-7081-4482-b8a9-5647695f323d tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:19.475447 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-ed55317d-7081-4482-b8a9-5647695f323d tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93774232c1479aa3e856bffb352140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b49ff217de14a2aae05d524128dec49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:19.486510 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-ed55317d-7081-4482-b8a9-5647695f323d tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] 10.222.0.59 "GET /compute/v2.1/servers/2507d827-8d75-49dd-9b79-351d7a7bb802" status: 200 len: 1314 microversion: 2.1 time: 0.321592 Aug 26 00:55:19.488033 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 120/231] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:19 2022] GET /compute/v2.1/servers/2507d827-8d75-49dd-9b79-351d7a7bb802 => generated 1314 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:19.942947 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-dcb01927-15c8-44cb-8be9-6aba354e213a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:19.942947 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-dcb01927-15c8-44cb-8be9-6aba354e213a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:19.945503 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-dcb01927-15c8-44cb-8be9-6aba354e213a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:19.945979 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-dcb01927-15c8-44cb-8be9-6aba354e213a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:19.946408 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-dcb01927-15c8-44cb-8be9-6aba354e213a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:19.947085 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-dcb01927-15c8-44cb-8be9-6aba354e213a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:19.947532 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-dcb01927-15c8-44cb-8be9-6aba354e213a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:19.947951 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-dcb01927-15c8-44cb-8be9-6aba354e213a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:20.103186 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-dcb01927-15c8-44cb-8be9-6aba354e213a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:20.111041 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-dcb01927-15c8-44cb-8be9-6aba354e213a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1523 microversion: 2.1 time: 0.176569 Aug 26 00:55:20.111609 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 112/232] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:19 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:20.507464 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-af41385a-4270-46cc-84ac-d1a0df1d0145 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:20.508073 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-af41385a-4270-46cc-84ac-d1a0df1d0145 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: 2507d827-8d75-49dd-9b79-351d7a7bb802] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:20.514026 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-af41385a-4270-46cc-84ac-d1a0df1d0145 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:20.514501 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-af41385a-4270-46cc-84ac-d1a0df1d0145 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:20.514932 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-af41385a-4270-46cc-84ac-d1a0df1d0145 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:20.515619 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-af41385a-4270-46cc-84ac-d1a0df1d0145 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:20.516060 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-af41385a-4270-46cc-84ac-d1a0df1d0145 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:20.516497 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-af41385a-4270-46cc-84ac-d1a0df1d0145 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:20.649074 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-af41385a-4270-46cc-84ac-d1a0df1d0145 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93774232c1479aa3e856bffb352140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b49ff217de14a2aae05d524128dec49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:20.656963 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-af41385a-4270-46cc-84ac-d1a0df1d0145 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] 10.222.0.59 "GET /compute/v2.1/servers/2507d827-8d75-49dd-9b79-351d7a7bb802" status: 200 len: 1314 microversion: 2.1 time: 0.153273 Aug 26 00:55:20.657530 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 121/233] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:20 2022] GET /compute/v2.1/servers/2507d827-8d75-49dd-9b79-351d7a7bb802 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:21.131096 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-768a5e7f-1d22-4a66-b3e0-79f72679bb31 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:21.132267 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-768a5e7f-1d22-4a66-b3e0-79f72679bb31 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:21.138614 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-768a5e7f-1d22-4a66-b3e0-79f72679bb31 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:21.139077 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-768a5e7f-1d22-4a66-b3e0-79f72679bb31 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:21.139556 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-768a5e7f-1d22-4a66-b3e0-79f72679bb31 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:21.140252 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-768a5e7f-1d22-4a66-b3e0-79f72679bb31 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:21.140723 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-768a5e7f-1d22-4a66-b3e0-79f72679bb31 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:21.141140 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-768a5e7f-1d22-4a66-b3e0-79f72679bb31 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:21.282471 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-768a5e7f-1d22-4a66-b3e0-79f72679bb31 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:21.290048 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-768a5e7f-1d22-4a66-b3e0-79f72679bb31 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1523 microversion: 2.1 time: 0.162667 Aug 26 00:55:21.290924 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 113/234] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:21 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:21.678956 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-b7e9babe-f29d-4cff-86d1-73b1804fb8a9 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:21.679564 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-b7e9babe-f29d-4cff-86d1-73b1804fb8a9 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: 2507d827-8d75-49dd-9b79-351d7a7bb802] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:21.685650 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b7e9babe-f29d-4cff-86d1-73b1804fb8a9 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:21.686178 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b7e9babe-f29d-4cff-86d1-73b1804fb8a9 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:21.686609 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b7e9babe-f29d-4cff-86d1-73b1804fb8a9 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:21.687305 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b7e9babe-f29d-4cff-86d1-73b1804fb8a9 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:21.687766 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b7e9babe-f29d-4cff-86d1-73b1804fb8a9 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:21.688164 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b7e9babe-f29d-4cff-86d1-73b1804fb8a9 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:21.885179 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-b7e9babe-f29d-4cff-86d1-73b1804fb8a9 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93774232c1479aa3e856bffb352140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b49ff217de14a2aae05d524128dec49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:21.893735 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-b7e9babe-f29d-4cff-86d1-73b1804fb8a9 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] 10.222.0.59 "GET /compute/v2.1/servers/2507d827-8d75-49dd-9b79-351d7a7bb802" status: 200 len: 1314 microversion: 2.1 time: 0.218870 Aug 26 00:55:21.894814 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 122/235] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:21 2022] GET /compute/v2.1/servers/2507d827-8d75-49dd-9b79-351d7a7bb802 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:22.311166 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-7f5cb7d7-6d2d-4d16-9c34-14b14b5a753c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:22.313668 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-7f5cb7d7-6d2d-4d16-9c34-14b14b5a753c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:22.314891 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell0:SELECT=2 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:55:22.319098 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7f5cb7d7-6d2d-4d16-9c34-14b14b5a753c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:22.319811 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7f5cb7d7-6d2d-4d16-9c34-14b14b5a753c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:22.320614 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7f5cb7d7-6d2d-4d16-9c34-14b14b5a753c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:22.321625 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7f5cb7d7-6d2d-4d16-9c34-14b14b5a753c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:22.322227 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7f5cb7d7-6d2d-4d16-9c34-14b14b5a753c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:22.322809 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7f5cb7d7-6d2d-4d16-9c34-14b14b5a753c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:22.495008 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-7f5cb7d7-6d2d-4d16-9c34-14b14b5a753c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:22.503020 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-7f5cb7d7-6d2d-4d16-9c34-14b14b5a753c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1523 microversion: 2.1 time: 0.195656 Aug 26 00:55:22.503599 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 114/236] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:22 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1523 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:22.916770 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-7da9f2cc-4f4c-4fab-ab08-f48bc73b44dc tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:22.917431 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-7da9f2cc-4f4c-4fab-ab08-f48bc73b44dc tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: 2507d827-8d75-49dd-9b79-351d7a7bb802] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:22.923519 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-7da9f2cc-4f4c-4fab-ab08-f48bc73b44dc tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:22.924000 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-7da9f2cc-4f4c-4fab-ab08-f48bc73b44dc tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:22.924426 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-7da9f2cc-4f4c-4fab-ab08-f48bc73b44dc tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:22.925644 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-7da9f2cc-4f4c-4fab-ab08-f48bc73b44dc tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:22.926090 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-7da9f2cc-4f4c-4fab-ab08-f48bc73b44dc tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:22.926507 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-7da9f2cc-4f4c-4fab-ab08-f48bc73b44dc tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:23.055731 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-7da9f2cc-4f4c-4fab-ab08-f48bc73b44dc tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93774232c1479aa3e856bffb352140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b49ff217de14a2aae05d524128dec49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:23.063628 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-7da9f2cc-4f4c-4fab-ab08-f48bc73b44dc tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] 10.222.0.59 "GET /compute/v2.1/servers/2507d827-8d75-49dd-9b79-351d7a7bb802" status: 200 len: 1314 microversion: 2.1 time: 0.150793 Aug 26 00:55:23.064189 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 123/237] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:22 2022] GET /compute/v2.1/servers/2507d827-8d75-49dd-9b79-351d7a7bb802 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:23.523385 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-949b8b52-8ec7-4f9d-a7d0-c967194b4833 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:23.524002 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-949b8b52-8ec7-4f9d-a7d0-c967194b4833 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:23.526314 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell0:SELECT=10 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:55:23.531570 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-949b8b52-8ec7-4f9d-a7d0-c967194b4833 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:23.532057 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-949b8b52-8ec7-4f9d-a7d0-c967194b4833 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:23.532509 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-949b8b52-8ec7-4f9d-a7d0-c967194b4833 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:23.533232 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-949b8b52-8ec7-4f9d-a7d0-c967194b4833 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:23.533679 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-949b8b52-8ec7-4f9d-a7d0-c967194b4833 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:23.534648 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-949b8b52-8ec7-4f9d-a7d0-c967194b4833 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:23.670174 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-949b8b52-8ec7-4f9d-a7d0-c967194b4833 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:23.678288 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-949b8b52-8ec7-4f9d-a7d0-c967194b4833 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1523 microversion: 2.1 time: 0.158829 Aug 26 00:55:23.678864 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 115/238] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:23 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:24.083835 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-ff61e950-e86f-4305-b927-313a10283b3e tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:24.084445 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-ff61e950-e86f-4305-b927-313a10283b3e tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: 2507d827-8d75-49dd-9b79-351d7a7bb802] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:24.090520 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ff61e950-e86f-4305-b927-313a10283b3e tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:24.091004 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ff61e950-e86f-4305-b927-313a10283b3e tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:24.091436 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ff61e950-e86f-4305-b927-313a10283b3e tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:24.092304 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ff61e950-e86f-4305-b927-313a10283b3e tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:24.092779 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ff61e950-e86f-4305-b927-313a10283b3e tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:24.093201 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ff61e950-e86f-4305-b927-313a10283b3e tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:24.236719 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-ff61e950-e86f-4305-b927-313a10283b3e tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93774232c1479aa3e856bffb352140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b49ff217de14a2aae05d524128dec49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:24.256433 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-ff61e950-e86f-4305-b927-313a10283b3e tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] 10.222.0.59 "GET /compute/v2.1/servers/2507d827-8d75-49dd-9b79-351d7a7bb802" status: 200 len: 1314 microversion: 2.1 time: 0.172408 Aug 26 00:55:24.256433 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 124/239] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:24 2022] GET /compute/v2.1/servers/2507d827-8d75-49dd-9b79-351d7a7bb802 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:24.483415 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [req-edeeb707-a6bb-41e9-995d-5722dbd1e174 req-8b206221-bc6b-44cd-9e1f-e0e5fc251ab2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2507d827-8d75-49dd-9b79-351d7a7bb802", "name": "network-vif-plugged", "status": "completed", "tag": "c5ac9a09-0d7c-4533-8c40-8f7bb360d0fe"}]} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:55:24.493000 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-edeeb707-a6bb-41e9-995d-5722dbd1e174 req-8b206221-bc6b-44cd-9e1f-e0e5fc251ab2 service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:24.493691 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-edeeb707-a6bb-41e9-995d-5722dbd1e174 req-8b206221-bc6b-44cd-9e1f-e0e5fc251ab2 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:24.494119 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-edeeb707-a6bb-41e9-995d-5722dbd1e174 req-8b206221-bc6b-44cd-9e1f-e0e5fc251ab2 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:24.506546 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.compute.server_external_events [req-edeeb707-a6bb-41e9-995d-5722dbd1e174 req-8b206221-bc6b-44cd-9e1f-e0e5fc251ab2 service nova] Creating event network-vif-plugged:c5ac9a09-0d7c-4533-8c40-8f7bb360d0fe for instance 2507d827-8d75-49dd-9b79-351d7a7bb802 on hv-cinder-83538 Aug 26 00:55:24.512528 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [req-edeeb707-a6bb-41e9-995d-5722dbd1e174 req-8b206221-bc6b-44cd-9e1f-e0e5fc251ab2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034389 Aug 26 00:55:24.513482 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 116/240] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 00:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:55:24.699057 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-244c8189-2f5b-4aef-aeeb-4daf88493309 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:24.699667 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-244c8189-2f5b-4aef-aeeb-4daf88493309 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:24.705613 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-244c8189-2f5b-4aef-aeeb-4daf88493309 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:24.715274 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-244c8189-2f5b-4aef-aeeb-4daf88493309 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:24.715274 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-244c8189-2f5b-4aef-aeeb-4daf88493309 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:24.715274 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-244c8189-2f5b-4aef-aeeb-4daf88493309 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:24.715274 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-244c8189-2f5b-4aef-aeeb-4daf88493309 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:24.715636 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-244c8189-2f5b-4aef-aeeb-4daf88493309 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:24.838066 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-244c8189-2f5b-4aef-aeeb-4daf88493309 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:24.846006 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-244c8189-2f5b-4aef-aeeb-4daf88493309 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1523 microversion: 2.1 time: 0.150829 Aug 26 00:55:24.852687 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 125/241] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:24 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:25.275349 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-bde81f56-64c5-4345-b286-abf907f5933d tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:25.276050 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-bde81f56-64c5-4345-b286-abf907f5933d tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: 2507d827-8d75-49dd-9b79-351d7a7bb802] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:25.282782 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-bde81f56-64c5-4345-b286-abf907f5933d tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:25.286087 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-bde81f56-64c5-4345-b286-abf907f5933d tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:25.286087 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-bde81f56-64c5-4345-b286-abf907f5933d tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:25.286087 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-bde81f56-64c5-4345-b286-abf907f5933d tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:25.286087 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-bde81f56-64c5-4345-b286-abf907f5933d tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:25.286811 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-bde81f56-64c5-4345-b286-abf907f5933d tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:25.419431 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-bde81f56-64c5-4345-b286-abf907f5933d tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93774232c1479aa3e856bffb352140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b49ff217de14a2aae05d524128dec49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:25.427588 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-bde81f56-64c5-4345-b286-abf907f5933d tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] 10.222.0.59 "GET /compute/v2.1/servers/2507d827-8d75-49dd-9b79-351d7a7bb802" status: 200 len: 1314 microversion: 2.1 time: 0.156368 Aug 26 00:55:25.428156 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 117/242] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:25 2022] GET /compute/v2.1/servers/2507d827-8d75-49dd-9b79-351d7a7bb802 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:25.870983 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-8edf614d-e801-45b6-9bbd-3f110a86dace tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:25.872172 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-8edf614d-e801-45b6-9bbd-3f110a86dace tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:25.878453 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8edf614d-e801-45b6-9bbd-3f110a86dace tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:25.879541 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8edf614d-e801-45b6-9bbd-3f110a86dace tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:25.879772 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8edf614d-e801-45b6-9bbd-3f110a86dace tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:25.880685 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8edf614d-e801-45b6-9bbd-3f110a86dace tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:25.881286 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8edf614d-e801-45b6-9bbd-3f110a86dace tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:25.881860 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8edf614d-e801-45b6-9bbd-3f110a86dace tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:26.094355 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-8edf614d-e801-45b6-9bbd-3f110a86dace tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:26.102836 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-8edf614d-e801-45b6-9bbd-3f110a86dace tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1523 microversion: 2.1 time: 0.235572 Aug 26 00:55:26.103414 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 126/243] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:25 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1523 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:26.448787 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-9584126e-e82a-4662-84d5-b107e834a4aa tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:26.449408 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-9584126e-e82a-4662-84d5-b107e834a4aa tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: 2507d827-8d75-49dd-9b79-351d7a7bb802] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:26.455523 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9584126e-e82a-4662-84d5-b107e834a4aa tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:26.456698 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9584126e-e82a-4662-84d5-b107e834a4aa tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:26.457232 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9584126e-e82a-4662-84d5-b107e834a4aa tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:26.458314 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9584126e-e82a-4662-84d5-b107e834a4aa tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:26.458795 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9584126e-e82a-4662-84d5-b107e834a4aa tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:26.459218 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9584126e-e82a-4662-84d5-b107e834a4aa tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:26.596606 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-9584126e-e82a-4662-84d5-b107e834a4aa tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93774232c1479aa3e856bffb352140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b49ff217de14a2aae05d524128dec49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:26.604443 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-9584126e-e82a-4662-84d5-b107e834a4aa tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] 10.222.0.59 "GET /compute/v2.1/servers/2507d827-8d75-49dd-9b79-351d7a7bb802" status: 200 len: 1314 microversion: 2.1 time: 0.159383 Aug 26 00:55:26.605267 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 118/244] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:26 2022] GET /compute/v2.1/servers/2507d827-8d75-49dd-9b79-351d7a7bb802 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:27.123542 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-8f39f242-5f7c-42cf-8491-c26c5a07f92d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:27.124205 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-8f39f242-5f7c-42cf-8491-c26c5a07f92d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:27.130329 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8f39f242-5f7c-42cf-8491-c26c5a07f92d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:27.130819 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8f39f242-5f7c-42cf-8491-c26c5a07f92d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:27.131352 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8f39f242-5f7c-42cf-8491-c26c5a07f92d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:27.132040 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8f39f242-5f7c-42cf-8491-c26c5a07f92d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:27.132508 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8f39f242-5f7c-42cf-8491-c26c5a07f92d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:27.132933 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8f39f242-5f7c-42cf-8491-c26c5a07f92d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:27.298184 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-8f39f242-5f7c-42cf-8491-c26c5a07f92d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:27.309306 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-8f39f242-5f7c-42cf-8491-c26c5a07f92d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1523 microversion: 2.1 time: 0.189228 Aug 26 00:55:27.310502 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 127/245] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:27 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1523 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:27.627089 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-67bc24a1-e720-4974-8073-e4285bc70d13 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:27.627771 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-67bc24a1-e720-4974-8073-e4285bc70d13 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: 2507d827-8d75-49dd-9b79-351d7a7bb802] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:27.636269 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-67bc24a1-e720-4974-8073-e4285bc70d13 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:27.636897 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-67bc24a1-e720-4974-8073-e4285bc70d13 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:27.637416 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-67bc24a1-e720-4974-8073-e4285bc70d13 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:27.638202 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-67bc24a1-e720-4974-8073-e4285bc70d13 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:27.638850 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-67bc24a1-e720-4974-8073-e4285bc70d13 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:27.639467 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-67bc24a1-e720-4974-8073-e4285bc70d13 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:27.780814 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-67bc24a1-e720-4974-8073-e4285bc70d13 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93774232c1479aa3e856bffb352140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b49ff217de14a2aae05d524128dec49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:27.790566 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-67bc24a1-e720-4974-8073-e4285bc70d13 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] 10.222.0.59 "GET /compute/v2.1/servers/2507d827-8d75-49dd-9b79-351d7a7bb802" status: 200 len: 1498 microversion: 2.1 time: 0.168652 Aug 26 00:55:27.791146 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 119/246] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:27 2022] GET /compute/v2.1/servers/2507d827-8d75-49dd-9b79-351d7a7bb802 => generated 1498 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:28.345459 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-20b4a00d-3e25-4098-b848-cbd8dce88beb tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:28.346005 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-20b4a00d-3e25-4098-b848-cbd8dce88beb tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:28.353063 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-20b4a00d-3e25-4098-b848-cbd8dce88beb tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:28.353297 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-20b4a00d-3e25-4098-b848-cbd8dce88beb tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:28.353593 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-20b4a00d-3e25-4098-b848-cbd8dce88beb tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:28.354289 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-20b4a00d-3e25-4098-b848-cbd8dce88beb tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:28.354744 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-20b4a00d-3e25-4098-b848-cbd8dce88beb tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:28.355171 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-20b4a00d-3e25-4098-b848-cbd8dce88beb tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:28.506652 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-20b4a00d-3e25-4098-b848-cbd8dce88beb tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:28.515708 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-20b4a00d-3e25-4098-b848-cbd8dce88beb tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1523 microversion: 2.1 time: 0.174184 Aug 26 00:55:28.516304 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 128/247] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:28 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:29.030203 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-61d43f01-dd64-4afb-9ab8-4f863d19e279 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:29.041486 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-61d43f01-dd64-4afb-9ab8-4f863d19e279 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: 2507d827-8d75-49dd-9b79-351d7a7bb802] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:29.041486 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-61d43f01-dd64-4afb-9ab8-4f863d19e279 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:29.041994 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-61d43f01-dd64-4afb-9ab8-4f863d19e279 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:29.042386 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-61d43f01-dd64-4afb-9ab8-4f863d19e279 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:29.043106 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-61d43f01-dd64-4afb-9ab8-4f863d19e279 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:29.043550 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-61d43f01-dd64-4afb-9ab8-4f863d19e279 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:29.044170 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-61d43f01-dd64-4afb-9ab8-4f863d19e279 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:29.076981 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-61d43f01-dd64-4afb-9ab8-4f863d19e279 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: 2507d827-8d75-49dd-9b79-351d7a7bb802] Going to try to terminate instance {{(pid=127565) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 00:55:29.404625 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-61d43f01-dd64-4afb-9ab8-4f863d19e279 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] 10.222.0.59 "DELETE /compute/v2.1/servers/2507d827-8d75-49dd-9b79-351d7a7bb802" status: 204 len: 0 microversion: 2.1 time: 0.378681 Aug 26 00:55:29.404625 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 120/248] 10.222.0.59 () {58 vars in 1239 bytes} [Fri Aug 26 00:55:29 2022] DELETE /compute/v2.1/servers/2507d827-8d75-49dd-9b79-351d7a7bb802 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 00:55:29.415208 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-5f5b3bfc-06d4-46cf-b03d-129d3b78ff65 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:29.417117 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-5f5b3bfc-06d4-46cf-b03d-129d3b78ff65 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: 2507d827-8d75-49dd-9b79-351d7a7bb802] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:29.424271 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5f5b3bfc-06d4-46cf-b03d-129d3b78ff65 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:29.425018 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5f5b3bfc-06d4-46cf-b03d-129d3b78ff65 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:29.425874 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5f5b3bfc-06d4-46cf-b03d-129d3b78ff65 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:29.426657 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5f5b3bfc-06d4-46cf-b03d-129d3b78ff65 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:29.427324 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5f5b3bfc-06d4-46cf-b03d-129d3b78ff65 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:29.427895 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5f5b3bfc-06d4-46cf-b03d-129d3b78ff65 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:29.538737 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-1f992776-34a4-4781-bcad-ae74bc6d5817 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:29.539904 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-1f992776-34a4-4781-bcad-ae74bc6d5817 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:29.546940 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1f992776-34a4-4781-bcad-ae74bc6d5817 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:29.547635 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1f992776-34a4-4781-bcad-ae74bc6d5817 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:29.548228 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1f992776-34a4-4781-bcad-ae74bc6d5817 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:29.549141 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1f992776-34a4-4781-bcad-ae74bc6d5817 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:29.549931 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1f992776-34a4-4781-bcad-ae74bc6d5817 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:29.550351 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1f992776-34a4-4781-bcad-ae74bc6d5817 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:29.579101 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-5f5b3bfc-06d4-46cf-b03d-129d3b78ff65 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93774232c1479aa3e856bffb352140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b49ff217de14a2aae05d524128dec49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:29.588681 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-5f5b3bfc-06d4-46cf-b03d-129d3b78ff65 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] 10.222.0.59 "GET /compute/v2.1/servers/2507d827-8d75-49dd-9b79-351d7a7bb802" status: 200 len: 1504 microversion: 2.1 time: 0.179533 Aug 26 00:55:29.588681 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 129/249] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:29 2022] GET /compute/v2.1/servers/2507d827-8d75-49dd-9b79-351d7a7bb802 => generated 1504 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:55:29.727662 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-1f992776-34a4-4781-bcad-ae74bc6d5817 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:29.738824 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-1f992776-34a4-4781-bcad-ae74bc6d5817 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1523 microversion: 2.1 time: 0.205485 Aug 26 00:55:29.739743 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 121/250] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:29 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1523 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:55:30.608340 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-74d7f5fe-8139-47ee-82d1-f223bf251c78 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:30.609041 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-74d7f5fe-8139-47ee-82d1-f223bf251c78 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: 2507d827-8d75-49dd-9b79-351d7a7bb802] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:30.615630 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-74d7f5fe-8139-47ee-82d1-f223bf251c78 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:30.616114 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-74d7f5fe-8139-47ee-82d1-f223bf251c78 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:30.616679 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-74d7f5fe-8139-47ee-82d1-f223bf251c78 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:30.617371 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-74d7f5fe-8139-47ee-82d1-f223bf251c78 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:30.617834 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-74d7f5fe-8139-47ee-82d1-f223bf251c78 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:30.618233 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-74d7f5fe-8139-47ee-82d1-f223bf251c78 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:30.767654 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-e207879d-d2c1-496f-93ec-7920455f962b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:30.776428 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-e207879d-d2c1-496f-93ec-7920455f962b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:30.783467 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e207879d-d2c1-496f-93ec-7920455f962b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:30.784751 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e207879d-d2c1-496f-93ec-7920455f962b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:30.785867 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e207879d-d2c1-496f-93ec-7920455f962b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:30.787049 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e207879d-d2c1-496f-93ec-7920455f962b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:30.787859 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e207879d-d2c1-496f-93ec-7920455f962b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:30.788666 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e207879d-d2c1-496f-93ec-7920455f962b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:30.794304 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:55:30.795822 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-74d7f5fe-8139-47ee-82d1-f223bf251c78 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93774232c1479aa3e856bffb352140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b49ff217de14a2aae05d524128dec49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:30.816904 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-74d7f5fe-8139-47ee-82d1-f223bf251c78 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] 10.222.0.59 "GET /compute/v2.1/servers/2507d827-8d75-49dd-9b79-351d7a7bb802" status: 200 len: 1504 microversion: 2.1 time: 0.200165 Aug 26 00:55:30.816904 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 130/251] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:30 2022] GET /compute/v2.1/servers/2507d827-8d75-49dd-9b79-351d7a7bb802 => generated 1504 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:30.971918 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-e207879d-d2c1-496f-93ec-7920455f962b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:30.981121 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-e207879d-d2c1-496f-93ec-7920455f962b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1523 microversion: 2.1 time: 0.223411 Aug 26 00:55:30.981590 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 122/252] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:30 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1523 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:31.826610 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-802de00d-594e-4c19-a8af-9e0af00ac921 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:31.827214 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-802de00d-594e-4c19-a8af-9e0af00ac921 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: 2507d827-8d75-49dd-9b79-351d7a7bb802] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:31.834244 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-802de00d-594e-4c19-a8af-9e0af00ac921 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:31.836829 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-802de00d-594e-4c19-a8af-9e0af00ac921 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:31.836829 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-802de00d-594e-4c19-a8af-9e0af00ac921 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:31.836829 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-802de00d-594e-4c19-a8af-9e0af00ac921 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:31.837284 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-802de00d-594e-4c19-a8af-9e0af00ac921 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:31.837375 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-802de00d-594e-4c19-a8af-9e0af00ac921 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:31.973937 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-802de00d-594e-4c19-a8af-9e0af00ac921 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93774232c1479aa3e856bffb352140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b49ff217de14a2aae05d524128dec49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:31.981706 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-802de00d-594e-4c19-a8af-9e0af00ac921 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] 10.222.0.59 "GET /compute/v2.1/servers/2507d827-8d75-49dd-9b79-351d7a7bb802" status: 200 len: 1504 microversion: 2.1 time: 0.158946 Aug 26 00:55:31.987579 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 131/253] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:31 2022] GET /compute/v2.1/servers/2507d827-8d75-49dd-9b79-351d7a7bb802 => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:32.001369 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-174220e2-cd69-49aa-8ac6-4a053918a07f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:32.002004 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-174220e2-cd69-49aa-8ac6-4a053918a07f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:32.009807 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-174220e2-cd69-49aa-8ac6-4a053918a07f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:32.010224 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-174220e2-cd69-49aa-8ac6-4a053918a07f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:32.010655 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-174220e2-cd69-49aa-8ac6-4a053918a07f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:32.011336 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-174220e2-cd69-49aa-8ac6-4a053918a07f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:32.011783 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-174220e2-cd69-49aa-8ac6-4a053918a07f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:32.012203 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-174220e2-cd69-49aa-8ac6-4a053918a07f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:32.148785 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-174220e2-cd69-49aa-8ac6-4a053918a07f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:32.156326 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-174220e2-cd69-49aa-8ac6-4a053918a07f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1523 microversion: 2.1 time: 0.158702 Aug 26 00:55:32.156906 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 123/254] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:31 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:55:33.003871 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-ff1ae80d-fa06-47e0-8777-84cca1617972 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:33.004758 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-ff1ae80d-fa06-47e0-8777-84cca1617972 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: 2507d827-8d75-49dd-9b79-351d7a7bb802] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:33.010560 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ff1ae80d-fa06-47e0-8777-84cca1617972 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:33.011124 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ff1ae80d-fa06-47e0-8777-84cca1617972 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:33.011513 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ff1ae80d-fa06-47e0-8777-84cca1617972 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:33.012192 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ff1ae80d-fa06-47e0-8777-84cca1617972 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:33.012666 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ff1ae80d-fa06-47e0-8777-84cca1617972 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:33.013084 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ff1ae80d-fa06-47e0-8777-84cca1617972 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:33.158971 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-ff1ae80d-fa06-47e0-8777-84cca1617972 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93774232c1479aa3e856bffb352140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b49ff217de14a2aae05d524128dec49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:33.166925 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-ff1ae80d-fa06-47e0-8777-84cca1617972 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] 10.222.0.59 "GET /compute/v2.1/servers/2507d827-8d75-49dd-9b79-351d7a7bb802" status: 200 len: 1504 microversion: 2.1 time: 0.167408 Aug 26 00:55:33.167482 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 132/255] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:32 2022] GET /compute/v2.1/servers/2507d827-8d75-49dd-9b79-351d7a7bb802 => generated 1504 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:33.177277 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-a619410c-6253-44db-a2b8-c9562d6ffa40 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:33.178511 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-a619410c-6253-44db-a2b8-c9562d6ffa40 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:33.185067 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a619410c-6253-44db-a2b8-c9562d6ffa40 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:33.185558 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a619410c-6253-44db-a2b8-c9562d6ffa40 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:33.185985 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a619410c-6253-44db-a2b8-c9562d6ffa40 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:33.186671 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a619410c-6253-44db-a2b8-c9562d6ffa40 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:33.187121 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a619410c-6253-44db-a2b8-c9562d6ffa40 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:33.187546 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a619410c-6253-44db-a2b8-c9562d6ffa40 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:33.385574 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-a619410c-6253-44db-a2b8-c9562d6ffa40 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:33.394308 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-a619410c-6253-44db-a2b8-c9562d6ffa40 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1503 microversion: 2.1 time: 0.220913 Aug 26 00:55:33.394963 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 124/256] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:33 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1503 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:33.415208 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-3f0bfed1-5866-4f16-9700-471093df5d4a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:33.415825 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-3f0bfed1-5866-4f16-9700-471093df5d4a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:33.421678 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3f0bfed1-5866-4f16-9700-471093df5d4a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:33.422160 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3f0bfed1-5866-4f16-9700-471093df5d4a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:33.422593 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3f0bfed1-5866-4f16-9700-471093df5d4a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:33.423320 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3f0bfed1-5866-4f16-9700-471093df5d4a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:33.423770 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3f0bfed1-5866-4f16-9700-471093df5d4a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:33.424193 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3f0bfed1-5866-4f16-9700-471093df5d4a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:33.582798 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-3f0bfed1-5866-4f16-9700-471093df5d4a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:33.590682 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-3f0bfed1-5866-4f16-9700-471093df5d4a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab" status: 200 len: 1516 microversion: 2.1 time: 0.179563 Aug 26 00:55:33.591242 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 133/257] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:33 2022] GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab => generated 1516 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:34.187664 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-6270d2ef-6d63-4ad0-88d5-974331710b09 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:34.188269 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-6270d2ef-6d63-4ad0-88d5-974331710b09 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: 2507d827-8d75-49dd-9b79-351d7a7bb802] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:34.195617 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6270d2ef-6d63-4ad0-88d5-974331710b09 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:34.196105 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6270d2ef-6d63-4ad0-88d5-974331710b09 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:34.196673 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6270d2ef-6d63-4ad0-88d5-974331710b09 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:34.197361 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6270d2ef-6d63-4ad0-88d5-974331710b09 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:34.197818 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6270d2ef-6d63-4ad0-88d5-974331710b09 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:34.198230 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6270d2ef-6d63-4ad0-88d5-974331710b09 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:34.349870 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-6270d2ef-6d63-4ad0-88d5-974331710b09 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93774232c1479aa3e856bffb352140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b49ff217de14a2aae05d524128dec49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:34.358194 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-6270d2ef-6d63-4ad0-88d5-974331710b09 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] 10.222.0.59 "GET /compute/v2.1/servers/2507d827-8d75-49dd-9b79-351d7a7bb802" status: 200 len: 1504 microversion: 2.1 time: 0.174271 Aug 26 00:55:34.358765 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 125/258] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:34 2022] GET /compute/v2.1/servers/2507d827-8d75-49dd-9b79-351d7a7bb802 => generated 1504 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:35.385237 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-178185f1-2620-475f-9356-56691e618be1 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:35.385715 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-178185f1-2620-475f-9356-56691e618be1 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: 2507d827-8d75-49dd-9b79-351d7a7bb802] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:35.398268 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-178185f1-2620-475f-9356-56691e618be1 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:35.398756 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-178185f1-2620-475f-9356-56691e618be1 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:35.399429 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-178185f1-2620-475f-9356-56691e618be1 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:35.400238 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-178185f1-2620-475f-9356-56691e618be1 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:35.401277 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-178185f1-2620-475f-9356-56691e618be1 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:35.401868 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-178185f1-2620-475f-9356-56691e618be1 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:35.650689 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-178185f1-2620-475f-9356-56691e618be1 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93774232c1479aa3e856bffb352140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b49ff217de14a2aae05d524128dec49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:35.660626 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-178185f1-2620-475f-9356-56691e618be1 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] 10.222.0.59 "GET /compute/v2.1/servers/2507d827-8d75-49dd-9b79-351d7a7bb802" status: 200 len: 1504 microversion: 2.1 time: 0.284633 Aug 26 00:55:35.661379 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 134/259] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:35 2022] GET /compute/v2.1/servers/2507d827-8d75-49dd-9b79-351d7a7bb802 => generated 1504 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:36.215677 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [req-f32bea0c-de1e-4cba-9f74-49d4c0f71343 req-6bf5d864-a131-413d-863d-bd9540044e5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2507d827-8d75-49dd-9b79-351d7a7bb802", "name": "network-vif-deleted", "tag": "c5ac9a09-0d7c-4533-8c40-8f7bb360d0fe"}]} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:55:36.226429 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-f32bea0c-de1e-4cba-9f74-49d4c0f71343 req-6bf5d864-a131-413d-863d-bd9540044e5c service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:36.226900 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-f32bea0c-de1e-4cba-9f74-49d4c0f71343 req-6bf5d864-a131-413d-863d-bd9540044e5c service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:36.227326 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-f32bea0c-de1e-4cba-9f74-49d4c0f71343 req-6bf5d864-a131-413d-863d-bd9540044e5c service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:36.239399 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.compute.server_external_events [req-f32bea0c-de1e-4cba-9f74-49d4c0f71343 req-6bf5d864-a131-413d-863d-bd9540044e5c service nova] Creating event network-vif-deleted:c5ac9a09-0d7c-4533-8c40-8f7bb360d0fe for instance 2507d827-8d75-49dd-9b79-351d7a7bb802 on hv-cinder-83538 Aug 26 00:55:36.244539 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [req-f32bea0c-de1e-4cba-9f74-49d4c0f71343 req-6bf5d864-a131-413d-863d-bd9540044e5c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032424 Aug 26 00:55:36.245137 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 126/260] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 00:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:55:36.513015 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-e499731e-0b94-4fc6-83af-b25369ee118c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:55:36.515540 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-e499731e-0b94-4fc6-83af-b25369ee118c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:36.522252 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e499731e-0b94-4fc6-83af-b25369ee118c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:36.522744 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e499731e-0b94-4fc6-83af-b25369ee118c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:36.523652 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e499731e-0b94-4fc6-83af-b25369ee118c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:36.524006 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e499731e-0b94-4fc6-83af-b25369ee118c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:36.524318 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e499731e-0b94-4fc6-83af-b25369ee118c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:36.524758 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e499731e-0b94-4fc6-83af-b25369ee118c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:36.539680 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell1:SELECT=100 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:55:36.550430 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.objects.instance [None req-e499731e-0b94-4fc6-83af-b25369ee118c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lazy-loading 'flavor' on Instance uuid 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab {{(pid=127564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 00:55:36.683183 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-9c822ce3-ead7-47ba-928c-dbd4675ed031 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:36.683878 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-9c822ce3-ead7-47ba-928c-dbd4675ed031 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: 2507d827-8d75-49dd-9b79-351d7a7bb802] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:36.690465 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9c822ce3-ead7-47ba-928c-dbd4675ed031 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:36.691234 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9c822ce3-ead7-47ba-928c-dbd4675ed031 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:36.691832 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9c822ce3-ead7-47ba-928c-dbd4675ed031 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:36.692862 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9c822ce3-ead7-47ba-928c-dbd4675ed031 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:36.693134 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9c822ce3-ead7-47ba-928c-dbd4675ed031 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:36.693563 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9c822ce3-ead7-47ba-928c-dbd4675ed031 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:36.727736 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9c822ce3-ead7-47ba-928c-dbd4675ed031 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:36.728289 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9c822ce3-ead7-47ba-928c-dbd4675ed031 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:36.728859 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9c822ce3-ead7-47ba-928c-dbd4675ed031 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:36.729392 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.objects.instance [None req-9c822ce3-ead7-47ba-928c-dbd4675ed031 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lazy-loading 'fault' on Instance uuid 2507d827-8d75-49dd-9b79-351d7a7bb802 {{(pid=127565) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 00:55:36.775760 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-9c822ce3-ead7-47ba-928c-dbd4675ed031 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93774232c1479aa3e856bffb352140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b49ff217de14a2aae05d524128dec49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:36.784721 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-9c822ce3-ead7-47ba-928c-dbd4675ed031 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] 10.222.0.59 "GET /compute/v2.1/servers/2507d827-8d75-49dd-9b79-351d7a7bb802" status: 200 len: 1304 microversion: 2.1 time: 0.105894 Aug 26 00:55:36.785363 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 127/261] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:36 2022] GET /compute/v2.1/servers/2507d827-8d75-49dd-9b79-351d7a7bb802 => generated 1304 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:55:36.910982 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-e499731e-0b94-4fc6-83af-b25369ee118c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "POST /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab/action" status: 200 len: 32 microversion: 2.1 time: 0.401506 Aug 26 00:55:36.912099 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 135/262] 10.222.0.59 () {60 vars in 1278 bytes} [Fri Aug 26 00:55:36 2022] POST /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab/action => generated 32 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 00:55:36.921692 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-521f474f-7f15-4718-82fb-dd58bf217521 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:36.922338 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-521f474f-7f15-4718-82fb-dd58bf217521 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:36.929044 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-521f474f-7f15-4718-82fb-dd58bf217521 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:36.929796 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-521f474f-7f15-4718-82fb-dd58bf217521 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:36.930241 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-521f474f-7f15-4718-82fb-dd58bf217521 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:36.932789 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-521f474f-7f15-4718-82fb-dd58bf217521 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:36.935051 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-521f474f-7f15-4718-82fb-dd58bf217521 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:36.935051 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-521f474f-7f15-4718-82fb-dd58bf217521 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:37.104376 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-521f474f-7f15-4718-82fb-dd58bf217521 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:37.113006 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-521f474f-7f15-4718-82fb-dd58bf217521 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab" status: 200 len: 1522 microversion: 2.1 time: 0.195311 Aug 26 00:55:37.113575 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 128/263] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:36 2022] GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:37.813309 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-0db30365-50ab-4548-8a76-db28382e2933 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:37.814044 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-0db30365-50ab-4548-8a76-db28382e2933 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: 2507d827-8d75-49dd-9b79-351d7a7bb802] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:37.820953 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-0db30365-50ab-4548-8a76-db28382e2933 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:37.821443 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-0db30365-50ab-4548-8a76-db28382e2933 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:37.821884 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-0db30365-50ab-4548-8a76-db28382e2933 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:37.822628 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-0db30365-50ab-4548-8a76-db28382e2933 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:37.823083 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-0db30365-50ab-4548-8a76-db28382e2933 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:37.823545 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-0db30365-50ab-4548-8a76-db28382e2933 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:37.857632 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-0db30365-50ab-4548-8a76-db28382e2933 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:37.858842 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-0db30365-50ab-4548-8a76-db28382e2933 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:37.859494 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-0db30365-50ab-4548-8a76-db28382e2933 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:37.859959 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.objects.instance [None req-0db30365-50ab-4548-8a76-db28382e2933 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lazy-loading 'fault' on Instance uuid 2507d827-8d75-49dd-9b79-351d7a7bb802 {{(pid=127564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 00:55:37.915543 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-0db30365-50ab-4548-8a76-db28382e2933 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93774232c1479aa3e856bffb352140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b49ff217de14a2aae05d524128dec49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:37.923675 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-0db30365-50ab-4548-8a76-db28382e2933 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] 10.222.0.59 "GET /compute/v2.1/servers/2507d827-8d75-49dd-9b79-351d7a7bb802" status: 200 len: 1304 microversion: 2.1 time: 0.114846 Aug 26 00:55:37.935246 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 136/264] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:37 2022] GET /compute/v2.1/servers/2507d827-8d75-49dd-9b79-351d7a7bb802 => generated 1304 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:38.134724 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-9a941a16-77ee-47fc-a034-1fe5e481db08 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:38.135473 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-9a941a16-77ee-47fc-a034-1fe5e481db08 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:38.142442 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9a941a16-77ee-47fc-a034-1fe5e481db08 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:38.142925 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9a941a16-77ee-47fc-a034-1fe5e481db08 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:38.143366 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9a941a16-77ee-47fc-a034-1fe5e481db08 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:38.144078 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9a941a16-77ee-47fc-a034-1fe5e481db08 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:38.144584 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9a941a16-77ee-47fc-a034-1fe5e481db08 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:38.145123 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9a941a16-77ee-47fc-a034-1fe5e481db08 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:38.279393 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-9a941a16-77ee-47fc-a034-1fe5e481db08 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:38.288073 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-9a941a16-77ee-47fc-a034-1fe5e481db08 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab" status: 200 len: 1522 microversion: 2.1 time: 0.157047 Aug 26 00:55:38.288451 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 129/265] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:38 2022] GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:38.947849 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-7cf18c16-6643-41a0-a3e1-4cee9358af5b tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:38.948849 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-7cf18c16-6643-41a0-a3e1-4cee9358af5b tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: 2507d827-8d75-49dd-9b79-351d7a7bb802] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:38.954753 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-7cf18c16-6643-41a0-a3e1-4cee9358af5b tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:38.955239 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-7cf18c16-6643-41a0-a3e1-4cee9358af5b tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:38.956217 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-7cf18c16-6643-41a0-a3e1-4cee9358af5b tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:38.957139 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-7cf18c16-6643-41a0-a3e1-4cee9358af5b tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:38.957720 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-7cf18c16-6643-41a0-a3e1-4cee9358af5b tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:38.958151 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-7cf18c16-6643-41a0-a3e1-4cee9358af5b tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:38.994288 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-7cf18c16-6643-41a0-a3e1-4cee9358af5b tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:38.994521 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-7cf18c16-6643-41a0-a3e1-4cee9358af5b tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:38.994960 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-7cf18c16-6643-41a0-a3e1-4cee9358af5b tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:38.995404 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.objects.instance [None req-7cf18c16-6643-41a0-a3e1-4cee9358af5b tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lazy-loading 'fault' on Instance uuid 2507d827-8d75-49dd-9b79-351d7a7bb802 {{(pid=127564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 00:55:39.047039 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-7cf18c16-6643-41a0-a3e1-4cee9358af5b tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93774232c1479aa3e856bffb352140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b49ff217de14a2aae05d524128dec49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:39.056345 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-7cf18c16-6643-41a0-a3e1-4cee9358af5b tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] 10.222.0.59 "GET /compute/v2.1/servers/2507d827-8d75-49dd-9b79-351d7a7bb802" status: 200 len: 1304 microversion: 2.1 time: 0.114758 Aug 26 00:55:39.057054 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 137/266] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:38 2022] GET /compute/v2.1/servers/2507d827-8d75-49dd-9b79-351d7a7bb802 => generated 1304 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:39.310462 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-2775bf50-7778-4e27-97e3-9bbd61bb4052 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:39.310909 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-2775bf50-7778-4e27-97e3-9bbd61bb4052 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:39.321176 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2775bf50-7778-4e27-97e3-9bbd61bb4052 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:39.321903 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2775bf50-7778-4e27-97e3-9bbd61bb4052 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:39.322747 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2775bf50-7778-4e27-97e3-9bbd61bb4052 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:39.324620 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2775bf50-7778-4e27-97e3-9bbd61bb4052 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:39.325356 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2775bf50-7778-4e27-97e3-9bbd61bb4052 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:39.332887 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2775bf50-7778-4e27-97e3-9bbd61bb4052 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:39.509010 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-2775bf50-7778-4e27-97e3-9bbd61bb4052 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:39.516529 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-2775bf50-7778-4e27-97e3-9bbd61bb4052 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab" status: 200 len: 1522 microversion: 2.1 time: 0.209954 Aug 26 00:55:39.533404 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 130/267] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:39 2022] GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:40.083398 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-96b32e89-f090-4199-a617-cf676d578510 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:40.084771 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-96b32e89-f090-4199-a617-cf676d578510 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: 2507d827-8d75-49dd-9b79-351d7a7bb802] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:40.101203 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-96b32e89-f090-4199-a617-cf676d578510 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:40.101792 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-96b32e89-f090-4199-a617-cf676d578510 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:40.102298 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-96b32e89-f090-4199-a617-cf676d578510 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:40.103633 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-96b32e89-f090-4199-a617-cf676d578510 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:40.104152 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-96b32e89-f090-4199-a617-cf676d578510 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:40.104713 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-96b32e89-f090-4199-a617-cf676d578510 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:40.139001 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-96b32e89-f090-4199-a617-cf676d578510 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:40.139495 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-96b32e89-f090-4199-a617-cf676d578510 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:40.139931 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-96b32e89-f090-4199-a617-cf676d578510 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:40.140381 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.objects.instance [None req-96b32e89-f090-4199-a617-cf676d578510 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lazy-loading 'fault' on Instance uuid 2507d827-8d75-49dd-9b79-351d7a7bb802 {{(pid=127564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 00:55:40.214297 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-96b32e89-f090-4199-a617-cf676d578510 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93774232c1479aa3e856bffb352140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b49ff217de14a2aae05d524128dec49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:40.223034 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-96b32e89-f090-4199-a617-cf676d578510 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] 10.222.0.59 "GET /compute/v2.1/servers/2507d827-8d75-49dd-9b79-351d7a7bb802" status: 200 len: 1304 microversion: 2.1 time: 0.144360 Aug 26 00:55:40.223620 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 138/268] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:40 2022] GET /compute/v2.1/servers/2507d827-8d75-49dd-9b79-351d7a7bb802 => generated 1304 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:40.540338 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-fc6d7187-874b-44ca-ae5c-808d2be0f059 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:40.542251 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-fc6d7187-874b-44ca-ae5c-808d2be0f059 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:40.551096 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-fc6d7187-874b-44ca-ae5c-808d2be0f059 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:40.551580 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-fc6d7187-874b-44ca-ae5c-808d2be0f059 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:40.552003 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-fc6d7187-874b-44ca-ae5c-808d2be0f059 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:40.553016 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-fc6d7187-874b-44ca-ae5c-808d2be0f059 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:40.553481 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-fc6d7187-874b-44ca-ae5c-808d2be0f059 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:40.554559 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-fc6d7187-874b-44ca-ae5c-808d2be0f059 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:40.722579 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-fc6d7187-874b-44ca-ae5c-808d2be0f059 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:40.733643 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-fc6d7187-874b-44ca-ae5c-808d2be0f059 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab" status: 200 len: 1522 microversion: 2.1 time: 0.198351 Aug 26 00:55:40.734243 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 131/269] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:40 2022] GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:40.801230 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-98d9d17b-d688-4149-a1a4-5d08f03050e0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:40.801948 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-98d9d17b-d688-4149-a1a4-5d08f03050e0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:40.807852 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-98d9d17b-d688-4149-a1a4-5d08f03050e0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:40.808324 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-98d9d17b-d688-4149-a1a4-5d08f03050e0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:40.808781 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-98d9d17b-d688-4149-a1a4-5d08f03050e0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:40.809455 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-98d9d17b-d688-4149-a1a4-5d08f03050e0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:40.809899 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-98d9d17b-d688-4149-a1a4-5d08f03050e0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:40.810312 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-98d9d17b-d688-4149-a1a4-5d08f03050e0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:40.835030 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-98d9d17b-d688-4149-a1a4-5d08f03050e0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b/ips" status: 200 len: 152 microversion: 2.20 time: 0.038305 Aug 26 00:55:40.840034 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 139/270] 10.222.0.59 () {60 vars in 1289 bytes} [Fri Aug 26 00:55:40 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 00:55:41.248972 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-b3ac7500-9c7d-4c16-ba05-6a6ccc7e7701 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:41.251170 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-b3ac7500-9c7d-4c16-ba05-6a6ccc7e7701 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: 2507d827-8d75-49dd-9b79-351d7a7bb802] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:41.263164 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b3ac7500-9c7d-4c16-ba05-6a6ccc7e7701 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:41.269806 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b3ac7500-9c7d-4c16-ba05-6a6ccc7e7701 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:41.270555 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b3ac7500-9c7d-4c16-ba05-6a6ccc7e7701 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:41.271518 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b3ac7500-9c7d-4c16-ba05-6a6ccc7e7701 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:41.272518 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b3ac7500-9c7d-4c16-ba05-6a6ccc7e7701 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:41.273123 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b3ac7500-9c7d-4c16-ba05-6a6ccc7e7701 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:41.462627 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.wsgi [None req-b3ac7500-9c7d-4c16-ba05-6a6ccc7e7701 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] HTTP exception thrown: Instance 2507d827-8d75-49dd-9b79-351d7a7bb802 could not be found. Aug 26 00:55:41.464685 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-b3ac7500-9c7d-4c16-ba05-6a6ccc7e7701 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Request method failure captured: Aug 26 00:55:41.464685 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: request: GET /compute/v2.1/servers/2507d827-8d75-49dd-9b79-351d7a7bb802 HTTP/1.1 Aug 26 00:55:41.464685 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Accept: application/json Aug 26 00:55:41.464685 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Accept-Encoding: identity Aug 26 00:55:41.464685 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Connection: close Aug 26 00:55:41.464685 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Content-Length: 0 Aug 26 00:55:41.464685 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Content-Type: application/json Aug 26 00:55:41.464685 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Host: 10.222.0.59 Aug 26 00:55:41.464685 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Openstack-System-Scope: None Aug 26 00:55:41.464685 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: User-Agent: python-urllib3/1.26.11 Aug 26 00:55:41.464685 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Auth-Token: gAAAAABjCBntts7oqcr5trZblssAxA8cXRmmy1X4k6fcnwQ0VzWAxvhP1LKtgC8yKn_TK6EBsQ7sxmj_TwKMepxjtPfVlcKATo2harLKPRXSJotB4aBuvESk57u6x8MSJoD8ZXtfEoRVLcNTN_AFhzqmTXivCqpcdKzhVoZhsR8Lb6e04mMY3eA Aug 26 00:55:41.464685 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Domain-Id: None Aug 26 00:55:41.464685 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Domain-Name: None Aug 26 00:55:41.464685 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Identity-Status: Confirmed Aug 26 00:55:41.464685 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Is-Admin-Project: True Aug 26 00:55:41.464685 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Domain-Id: default Aug 26 00:55:41.464685 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Domain-Name: Default Aug 26 00:55:41.464685 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Id: 9b49ff217de14a2aae05d524128dec49 Aug 26 00:55:41.464685 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Name: tempest-VolumesActionsTest-746620721 Aug 26 00:55:41.464685 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Role: reader,member Aug 26 00:55:41.464685 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Roles: reader,member Aug 26 00:55:41.466299 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9b49ff217de14a2aae05d524128dec49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9b49ff217de14a2aae05d524128dec49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9b49ff217de14a2aae05d524128dec49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9b49ff217de14a2aae05d524128dec49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 00:55:41.466299 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant: tempest-VolumesActionsTest-746620721 Aug 26 00:55:41.466299 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant-Id: 9b49ff217de14a2aae05d524128dec49 Aug 26 00:55:41.466299 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant-Name: tempest-VolumesActionsTest-746620721 Aug 26 00:55:41.466299 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User: tempest-VolumesActionsTest-746620721-project Aug 26 00:55:41.466299 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Domain-Id: default Aug 26 00:55:41.466299 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Domain-Name: Default Aug 26 00:55:41.466299 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Id: 2f93774232c1479aa3e856bffb352140 Aug 26 00:55:41.466299 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Name: tempest-VolumesActionsTest-746620721-project Aug 26 00:55:41.466299 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: method: > Aug 26 00:55:41.466299 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: exception: Instance 2507d827-8d75-49dd-9b79-351d7a7bb802 could not be found. Aug 26 00:55:41.466299 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: action_args: {'id': '2507d827-8d75-49dd-9b79-351d7a7bb802'} Aug 26 00:55:41.467176 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 00:55:41.467176 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:55:41.467176 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 00:55:41.467176 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 00:55:41.467176 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 00:55:41.467176 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 00:55:41.467176 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 00:55:41.467176 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 00:55:41.467176 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 00:55:41.467176 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 00:55:41.467176 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2507d827-8d75-49dd-9b79-351d7a7bb802 could not be found. Aug 26 00:55:41.467176 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:55:41.467176 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 00:55:41.467176 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:55:41.467176 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:55:41.467176 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 00:55:41.467176 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 00:55:41.467176 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 00:55:41.467176 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 00:55:41.467176 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 00:55:41.482103 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 00:55:41.482103 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 00:55:41.482103 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 00:55:41.482103 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 00:55:41.482103 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 00:55:41.482103 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 00:55:41.482103 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 00:55:41.482103 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2507d827-8d75-49dd-9b79-351d7a7bb802 could not be found. Aug 26 00:55:41.482103 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:55:41.482103 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 00:55:41.482103 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:55:41.482103 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:55:41.482103 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 00:55:41.482103 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 00:55:41.482103 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 00:55:41.482103 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 00:55:41.482103 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2507d827-8d75-49dd-9b79-351d7a7bb802 could not be found. Aug 26 00:55:41.482103 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:55:41.484089 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-b3ac7500-9c7d-4c16-ba05-6a6ccc7e7701 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Returning 404 to user: Instance 2507d827-8d75-49dd-9b79-351d7a7bb802 could not be found. {{(pid=127565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 00:55:41.484089 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-b3ac7500-9c7d-4c16-ba05-6a6ccc7e7701 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] 10.222.0.59 "GET /compute/v2.1/servers/2507d827-8d75-49dd-9b79-351d7a7bb802" status: 404 len: 111 microversion: 2.1 time: 0.226470 Aug 26 00:55:41.484089 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 132/271] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:41 2022] GET /compute/v2.1/servers/2507d827-8d75-49dd-9b79-351d7a7bb802 => generated 111 bytes in 231 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 00:55:41.614890 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-dbdbeefe-bdca-4b08-a828-ec84a132fd7d tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1855916217", "imageRef": "ef60327f-6e0c-4f85-8db9-6f6e8968fe9c", "flavorRef": "452", "networks": [{"uuid": "26ae3024-dc7c-4eb7-8ff7-8c6eee8da550"}]}} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:55:41.727674 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.network.neutron [None req-dbdbeefe-bdca-4b08-a828-ec84a132fd7d tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] validate_networks() for [('26ae3024-dc7c-4eb7-8ff7-8c6eee8da550', None, None, None, None, None)] {{(pid=127564) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 00:55:41.757985 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-d77ac429-d9e4-45ad-b849-eb7320186b1e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:41.759246 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-d77ac429-d9e4-45ad-b849-eb7320186b1e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:41.766896 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d77ac429-d9e4-45ad-b849-eb7320186b1e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:41.767477 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d77ac429-d9e4-45ad-b849-eb7320186b1e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:41.768127 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d77ac429-d9e4-45ad-b849-eb7320186b1e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:41.768828 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d77ac429-d9e4-45ad-b849-eb7320186b1e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:41.769345 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d77ac429-d9e4-45ad-b849-eb7320186b1e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:41.769989 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d77ac429-d9e4-45ad-b849-eb7320186b1e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:41.938643 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-d77ac429-d9e4-45ad-b849-eb7320186b1e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:41.951006 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-d77ac429-d9e4-45ad-b849-eb7320186b1e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab" status: 200 len: 1522 microversion: 2.1 time: 0.198781 Aug 26 00:55:41.952036 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 133/272] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:41 2022] GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:42.569927 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.virt.hardware [None req-dbdbeefe-bdca-4b08-a828-ec84a132fd7d tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Flavor limits 0:0:0 {{(pid=127564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 00:55:42.570644 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.virt.hardware [None req-dbdbeefe-bdca-4b08-a828-ec84a132fd7d tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Image limits 0:0:0 {{(pid=127564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 00:55:42.571339 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.virt.hardware [None req-dbdbeefe-bdca-4b08-a828-ec84a132fd7d tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Flavor pref 0:0:0 {{(pid=127564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 00:55:42.571889 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.virt.hardware [None req-dbdbeefe-bdca-4b08-a828-ec84a132fd7d tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Image pref 0:0:0 {{(pid=127564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 00:55:42.572404 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.virt.hardware [None req-dbdbeefe-bdca-4b08-a828-ec84a132fd7d tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 00:55:42.574738 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_api:SELECT=64 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:55:42.584645 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-dbdbeefe-bdca-4b08-a828-ec84a132fd7d tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:42.585409 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-dbdbeefe-bdca-4b08-a828-ec84a132fd7d tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:42.585980 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-dbdbeefe-bdca-4b08-a828-ec84a132fd7d tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:42.586811 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-dbdbeefe-bdca-4b08-a828-ec84a132fd7d tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:42.587421 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-dbdbeefe-bdca-4b08-a828-ec84a132fd7d tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:42.588090 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-dbdbeefe-bdca-4b08-a828-ec84a132fd7d tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:42.608381 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.quota [None req-dbdbeefe-bdca-4b08-a828-ec84a132fd7d tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Getting quotas for project 9b49ff217de14a2aae05d524128dec49. Resources: {'instances', 'ram', 'cores'} {{(pid=127564) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 00:55:42.613061 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.quota [None req-dbdbeefe-bdca-4b08-a828-ec84a132fd7d tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Getting quotas for user 2f93774232c1479aa3e856bffb352140 and project 9b49ff217de14a2aae05d524128dec49. Resources: {'instances', 'ram', 'cores'} {{(pid=127564) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 00:55:42.624417 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-dbdbeefe-bdca-4b08-a828-ec84a132fd7d tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Going to run 1 instances... {{(pid=127564) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 00:55:42.626730 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-dbdbeefe-bdca-4b08-a828-ec84a132fd7d tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: c56d5f8c-767e-4fa6-b714-d018853c73bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ef60327f-6e0c-4f85-8db9-6f6e8968fe9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 00:55:42.794059 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-dbdbeefe-bdca-4b08-a828-ec84a132fd7d tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.184706 Aug 26 00:55:42.818430 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-5bf42ef2-12f7-4b88-ab32-35df986d6f4d tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:42.819069 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-5bf42ef2-12f7-4b88-ab32-35df986d6f4d tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: c56d5f8c-767e-4fa6-b714-d018853c73bd] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:42.827705 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 140/273] 10.222.0.59 () {60 vars in 1147 bytes} [Fri Aug 26 00:55:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1196 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 00:55:42.937172 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-5bf42ef2-12f7-4b88-ab32-35df986d6f4d tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93774232c1479aa3e856bffb352140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b49ff217de14a2aae05d524128dec49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:42.946983 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-5bf42ef2-12f7-4b88-ab32-35df986d6f4d tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] 10.222.0.59 "GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd" status: 200 len: 1214 microversion: 2.1 time: 0.140600 Aug 26 00:55:42.949316 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 134/274] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:42 2022] GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd => generated 1214 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:42.975841 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-943cb5e5-803c-4ed9-a355-6694482cb8e8 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:42.976749 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-943cb5e5-803c-4ed9-a355-6694482cb8e8 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:42.985350 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-943cb5e5-803c-4ed9-a355-6694482cb8e8 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:42.991182 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-943cb5e5-803c-4ed9-a355-6694482cb8e8 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:42.991182 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-943cb5e5-803c-4ed9-a355-6694482cb8e8 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:42.992937 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-943cb5e5-803c-4ed9-a355-6694482cb8e8 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:42.998663 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-943cb5e5-803c-4ed9-a355-6694482cb8e8 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:42.999444 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-943cb5e5-803c-4ed9-a355-6694482cb8e8 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:43.349082 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-943cb5e5-803c-4ed9-a355-6694482cb8e8 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:43.349082 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-943cb5e5-803c-4ed9-a355-6694482cb8e8 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab" status: 200 len: 1522 microversion: 2.1 time: 0.333936 Aug 26 00:55:43.349082 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 141/275] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:42 2022] GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab => generated 1522 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:43.972031 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-640fc5ce-d06c-4370-8285-ae6e7f13d28f tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:43.973628 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-640fc5ce-d06c-4370-8285-ae6e7f13d28f tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: c56d5f8c-767e-4fa6-b714-d018853c73bd] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:44.034748 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-640fc5ce-d06c-4370-8285-ae6e7f13d28f tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93774232c1479aa3e856bffb352140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b49ff217de14a2aae05d524128dec49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:44.041989 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-640fc5ce-d06c-4370-8285-ae6e7f13d28f tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] 10.222.0.59 "GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd" status: 200 len: 1214 microversion: 2.1 time: 0.077015 Aug 26 00:55:44.055849 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 135/276] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:43 2022] GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd => generated 1214 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:44.366870 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-8bcd7b09-250d-4247-b0c5-ece99d666cfd tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:44.370464 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-8bcd7b09-250d-4247-b0c5-ece99d666cfd tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:44.376171 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8bcd7b09-250d-4247-b0c5-ece99d666cfd tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:44.377028 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8bcd7b09-250d-4247-b0c5-ece99d666cfd tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:44.378294 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8bcd7b09-250d-4247-b0c5-ece99d666cfd tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:44.379169 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8bcd7b09-250d-4247-b0c5-ece99d666cfd tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:44.379618 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8bcd7b09-250d-4247-b0c5-ece99d666cfd tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:44.380036 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8bcd7b09-250d-4247-b0c5-ece99d666cfd tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:44.550683 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-8bcd7b09-250d-4247-b0c5-ece99d666cfd tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:44.559227 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-8bcd7b09-250d-4247-b0c5-ece99d666cfd tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab" status: 200 len: 1522 microversion: 2.1 time: 0.196550 Aug 26 00:55:44.560081 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 142/277] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:44 2022] GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:44.565467 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-b6d04534-77d0-44b4-95a7-75265e7e1f1d tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:55:44.566208 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-b6d04534-77d0-44b4-95a7-75265e7e1f1d tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:44.572533 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b6d04534-77d0-44b4-95a7-75265e7e1f1d tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:44.573219 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b6d04534-77d0-44b4-95a7-75265e7e1f1d tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:44.573694 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b6d04534-77d0-44b4-95a7-75265e7e1f1d tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:44.574397 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b6d04534-77d0-44b4-95a7-75265e7e1f1d tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:44.574930 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b6d04534-77d0-44b4-95a7-75265e7e1f1d tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:44.575360 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b6d04534-77d0-44b4-95a7-75265e7e1f1d tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:44.601121 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.objects.instance [None req-b6d04534-77d0-44b4-95a7-75265e7e1f1d tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lazy-loading 'flavor' on Instance uuid 7502d0cf-4abc-484b-8c85-d8ea6682333b {{(pid=127565) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 00:55:45.062909 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-7ac62429-ff3c-4f23-b29e-3cc791fb0535 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:45.063652 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-7ac62429-ff3c-4f23-b29e-3cc791fb0535 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: c56d5f8c-767e-4fa6-b714-d018853c73bd] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:45.072133 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-7ac62429-ff3c-4f23-b29e-3cc791fb0535 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:45.072771 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-7ac62429-ff3c-4f23-b29e-3cc791fb0535 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:45.078009 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-7ac62429-ff3c-4f23-b29e-3cc791fb0535 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:45.078870 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-7ac62429-ff3c-4f23-b29e-3cc791fb0535 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:45.079424 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-7ac62429-ff3c-4f23-b29e-3cc791fb0535 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:45.081862 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-7ac62429-ff3c-4f23-b29e-3cc791fb0535 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:45.091145 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-b6d04534-77d0-44b4-95a7-75265e7e1f1d tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "POST /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b/action" status: 202 len: 0 microversion: 2.20 time: 0.530198 Aug 26 00:55:45.093197 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 136/278] 10.222.0.59 () {62 vars in 1319 bytes} [Fri Aug 26 00:55:44 2022] POST /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b/action => generated 0 bytes in 534 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 26 00:55:45.101852 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-e09971c7-b66d-4bef-90c7-c0e35201e898 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:45.103036 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-e09971c7-b66d-4bef-90c7-c0e35201e898 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:45.111242 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e09971c7-b66d-4bef-90c7-c0e35201e898 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:45.111777 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e09971c7-b66d-4bef-90c7-c0e35201e898 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:45.114329 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e09971c7-b66d-4bef-90c7-c0e35201e898 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:45.115266 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e09971c7-b66d-4bef-90c7-c0e35201e898 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:45.116010 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e09971c7-b66d-4bef-90c7-c0e35201e898 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:45.116692 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e09971c7-b66d-4bef-90c7-c0e35201e898 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:45.156813 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-7ac62429-ff3c-4f23-b29e-3cc791fb0535 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93774232c1479aa3e856bffb352140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b49ff217de14a2aae05d524128dec49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:45.165216 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-7ac62429-ff3c-4f23-b29e-3cc791fb0535 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] 10.222.0.59 "GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd" status: 200 len: 1218 microversion: 2.1 time: 0.106078 Aug 26 00:55:45.175013 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 143/279] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:45 2022] GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd => generated 1218 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:55:45.310625 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-e09971c7-b66d-4bef-90c7-c0e35201e898 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:45.320047 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-e09971c7-b66d-4bef-90c7-c0e35201e898 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:45.321660 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-e09971c7-b66d-4bef-90c7-c0e35201e898 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:45.323081 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-e09971c7-b66d-4bef-90c7-c0e35201e898 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1723 microversion: 2.20 time: 0.226296 Aug 26 00:55:45.325739 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 137/280] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:55:45 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:55:45.581773 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-0c433c6f-2245-4a7a-a065-68d9e46272e1 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:45.583021 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-0c433c6f-2245-4a7a-a065-68d9e46272e1 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:45.589080 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-0c433c6f-2245-4a7a-a065-68d9e46272e1 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:45.589569 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-0c433c6f-2245-4a7a-a065-68d9e46272e1 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:45.590009 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-0c433c6f-2245-4a7a-a065-68d9e46272e1 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:45.590707 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-0c433c6f-2245-4a7a-a065-68d9e46272e1 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:45.591158 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-0c433c6f-2245-4a7a-a065-68d9e46272e1 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:45.591770 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-0c433c6f-2245-4a7a-a065-68d9e46272e1 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:45.761064 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-0c433c6f-2245-4a7a-a065-68d9e46272e1 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:45.770838 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-0c433c6f-2245-4a7a-a065-68d9e46272e1 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab" status: 200 len: 1522 microversion: 2.1 time: 0.193461 Aug 26 00:55:45.774107 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 144/281] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:45 2022] GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:46.190026 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-e4034156-9a57-4fdb-acdd-b95cb7962203 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:46.196671 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-e4034156-9a57-4fdb-acdd-b95cb7962203 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: c56d5f8c-767e-4fa6-b714-d018853c73bd] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:46.199233 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e4034156-9a57-4fdb-acdd-b95cb7962203 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:46.199717 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e4034156-9a57-4fdb-acdd-b95cb7962203 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:46.200318 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e4034156-9a57-4fdb-acdd-b95cb7962203 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:46.201037 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e4034156-9a57-4fdb-acdd-b95cb7962203 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:46.201481 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e4034156-9a57-4fdb-acdd-b95cb7962203 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:46.202073 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e4034156-9a57-4fdb-acdd-b95cb7962203 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:46.265703 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-e4034156-9a57-4fdb-acdd-b95cb7962203 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93774232c1479aa3e856bffb352140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b49ff217de14a2aae05d524128dec49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:46.274563 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-e4034156-9a57-4fdb-acdd-b95cb7962203 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] 10.222.0.59 "GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd" status: 200 len: 1218 microversion: 2.1 time: 0.091760 Aug 26 00:55:46.275165 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 138/282] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:46 2022] GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:46.346286 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-a19a1eaf-37ca-4377-9d5e-c1a760750307 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:46.347710 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-a19a1eaf-37ca-4377-9d5e-c1a760750307 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:46.354126 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a19a1eaf-37ca-4377-9d5e-c1a760750307 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:46.354714 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a19a1eaf-37ca-4377-9d5e-c1a760750307 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:46.355239 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a19a1eaf-37ca-4377-9d5e-c1a760750307 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:46.356020 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a19a1eaf-37ca-4377-9d5e-c1a760750307 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:46.356583 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a19a1eaf-37ca-4377-9d5e-c1a760750307 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:46.357077 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a19a1eaf-37ca-4377-9d5e-c1a760750307 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:46.574127 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-a19a1eaf-37ca-4377-9d5e-c1a760750307 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:46.584209 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-a19a1eaf-37ca-4377-9d5e-c1a760750307 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:46.588499 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-a19a1eaf-37ca-4377-9d5e-c1a760750307 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:46.588499 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-a19a1eaf-37ca-4377-9d5e-c1a760750307 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1723 microversion: 2.20 time: 0.245612 Aug 26 00:55:46.588499 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 145/283] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:55:46 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1723 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:55:46.589839 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-2f11b6b9-df81-4c93-968c-c2be48b88606 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:46.590336 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-2f11b6b9-df81-4c93-968c-c2be48b88606 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:46.601650 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2f11b6b9-df81-4c93-968c-c2be48b88606 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:46.602515 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2f11b6b9-df81-4c93-968c-c2be48b88606 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:46.603549 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2f11b6b9-df81-4c93-968c-c2be48b88606 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:46.604696 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2f11b6b9-df81-4c93-968c-c2be48b88606 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:46.608430 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2f11b6b9-df81-4c93-968c-c2be48b88606 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:46.609162 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2f11b6b9-df81-4c93-968c-c2be48b88606 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:46.637235 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-2f11b6b9-df81-4c93-968c-c2be48b88606 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7/ips" status: 200 len: 144 microversion: 2.1 time: 0.051214 Aug 26 00:55:46.637815 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 139/284] 10.222.0.59 () {58 vars in 1248 bytes} [Fri Aug 26 00:55:46 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7/ips => generated 144 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:55:46.795647 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-bbba9f19-7e4d-4fdf-9519-9910b042e0f7 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:46.796259 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-bbba9f19-7e4d-4fdf-9519-9910b042e0f7 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:46.803395 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bbba9f19-7e4d-4fdf-9519-9910b042e0f7 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:46.807367 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bbba9f19-7e4d-4fdf-9519-9910b042e0f7 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:46.807367 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bbba9f19-7e4d-4fdf-9519-9910b042e0f7 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:46.807367 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bbba9f19-7e4d-4fdf-9519-9910b042e0f7 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:46.807367 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bbba9f19-7e4d-4fdf-9519-9910b042e0f7 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:46.807785 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bbba9f19-7e4d-4fdf-9519-9910b042e0f7 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:46.989410 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-bbba9f19-7e4d-4fdf-9519-9910b042e0f7 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:46.999436 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-bbba9f19-7e4d-4fdf-9519-9910b042e0f7 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab" status: 200 len: 1522 microversion: 2.1 time: 0.207586 Aug 26 00:55:47.013785 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 146/285] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:46 2022] GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:47.298582 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-c21463af-e0df-4f1e-ae81-f8005f2e737f tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:47.301200 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-c21463af-e0df-4f1e-ae81-f8005f2e737f tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: c56d5f8c-767e-4fa6-b714-d018853c73bd] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:47.322726 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c21463af-e0df-4f1e-ae81-f8005f2e737f tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:47.326145 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c21463af-e0df-4f1e-ae81-f8005f2e737f tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:47.327313 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c21463af-e0df-4f1e-ae81-f8005f2e737f tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:47.333918 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c21463af-e0df-4f1e-ae81-f8005f2e737f tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:47.334911 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c21463af-e0df-4f1e-ae81-f8005f2e737f tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:47.335564 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c21463af-e0df-4f1e-ae81-f8005f2e737f tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:47.378016 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:55:47.457291 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-c21463af-e0df-4f1e-ae81-f8005f2e737f tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93774232c1479aa3e856bffb352140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b49ff217de14a2aae05d524128dec49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:47.466498 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-c21463af-e0df-4f1e-ae81-f8005f2e737f tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] 10.222.0.59 "GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd" status: 200 len: 1218 microversion: 2.1 time: 0.173779 Aug 26 00:55:47.467405 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 140/286] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:47 2022] GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd => generated 1218 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:47.615295 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-21ed8618-da8e-4354-9eb4-bdae8b6b0960 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:47.615891 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-21ed8618-da8e-4354-9eb4-bdae8b6b0960 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:47.626920 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-21ed8618-da8e-4354-9eb4-bdae8b6b0960 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:47.627681 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-21ed8618-da8e-4354-9eb4-bdae8b6b0960 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:47.628105 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-21ed8618-da8e-4354-9eb4-bdae8b6b0960 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:47.628845 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-21ed8618-da8e-4354-9eb4-bdae8b6b0960 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:47.629294 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-21ed8618-da8e-4354-9eb4-bdae8b6b0960 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:47.629707 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-21ed8618-da8e-4354-9eb4-bdae8b6b0960 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:48.026741 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-9052815f-f474-4f8f-b362-10c24384797d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:48.027877 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-9052815f-f474-4f8f-b362-10c24384797d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:48.040325 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9052815f-f474-4f8f-b362-10c24384797d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:48.040325 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9052815f-f474-4f8f-b362-10c24384797d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:48.040325 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9052815f-f474-4f8f-b362-10c24384797d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:48.042169 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9052815f-f474-4f8f-b362-10c24384797d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:48.043045 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9052815f-f474-4f8f-b362-10c24384797d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:48.052034 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9052815f-f474-4f8f-b362-10c24384797d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:48.149964 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-21ed8618-da8e-4354-9eb4-bdae8b6b0960 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:48.161376 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-21ed8618-da8e-4354-9eb4-bdae8b6b0960 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:48.164402 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-21ed8618-da8e-4354-9eb4-bdae8b6b0960 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:48.166081 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-21ed8618-da8e-4354-9eb4-bdae8b6b0960 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1723 microversion: 2.20 time: 0.555394 Aug 26 00:55:48.167369 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 147/287] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:55:47 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1723 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:55:48.282325 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-9052815f-f474-4f8f-b362-10c24384797d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:48.291563 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-9052815f-f474-4f8f-b362-10c24384797d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab" status: 200 len: 1522 microversion: 2.1 time: 0.273640 Aug 26 00:55:48.302265 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 141/288] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:48 2022] GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab => generated 1522 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:48.489535 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-baf7ef50-0f2e-4e06-b9c5-3f02ff2bca27 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:48.489535 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-baf7ef50-0f2e-4e06-b9c5-3f02ff2bca27 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: c56d5f8c-767e-4fa6-b714-d018853c73bd] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:48.495450 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-baf7ef50-0f2e-4e06-b9c5-3f02ff2bca27 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:48.496106 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-baf7ef50-0f2e-4e06-b9c5-3f02ff2bca27 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:48.496875 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-baf7ef50-0f2e-4e06-b9c5-3f02ff2bca27 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:48.497678 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-baf7ef50-0f2e-4e06-b9c5-3f02ff2bca27 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:48.498231 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-baf7ef50-0f2e-4e06-b9c5-3f02ff2bca27 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:48.499540 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-baf7ef50-0f2e-4e06-b9c5-3f02ff2bca27 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:48.574012 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-baf7ef50-0f2e-4e06-b9c5-3f02ff2bca27 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93774232c1479aa3e856bffb352140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b49ff217de14a2aae05d524128dec49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:48.582911 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-baf7ef50-0f2e-4e06-b9c5-3f02ff2bca27 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] 10.222.0.59 "GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd" status: 200 len: 1266 microversion: 2.1 time: 0.099790 Aug 26 00:55:48.583493 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 148/289] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:48 2022] GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd => generated 1266 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:49.193544 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-b06df27e-c808-4c5c-a12f-693a474f2ddc tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:49.194313 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-b06df27e-c808-4c5c-a12f-693a474f2ddc tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:49.197146 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:55:49.202369 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b06df27e-c808-4c5c-a12f-693a474f2ddc tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:49.207267 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b06df27e-c808-4c5c-a12f-693a474f2ddc tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:49.207267 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b06df27e-c808-4c5c-a12f-693a474f2ddc tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:49.207267 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b06df27e-c808-4c5c-a12f-693a474f2ddc tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:49.207267 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b06df27e-c808-4c5c-a12f-693a474f2ddc tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:49.207580 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b06df27e-c808-4c5c-a12f-693a474f2ddc tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:49.314356 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-ff3699f6-136f-42d3-bdca-1f4b4c42ea4e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:49.315611 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-ff3699f6-136f-42d3-bdca-1f4b4c42ea4e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:49.322107 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ff3699f6-136f-42d3-bdca-1f4b4c42ea4e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:49.323081 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ff3699f6-136f-42d3-bdca-1f4b4c42ea4e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:49.323659 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ff3699f6-136f-42d3-bdca-1f4b4c42ea4e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:49.324360 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ff3699f6-136f-42d3-bdca-1f4b4c42ea4e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:49.324996 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ff3699f6-136f-42d3-bdca-1f4b4c42ea4e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:49.325536 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ff3699f6-136f-42d3-bdca-1f4b4c42ea4e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:49.442784 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-b06df27e-c808-4c5c-a12f-693a474f2ddc tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:49.465360 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-b06df27e-c808-4c5c-a12f-693a474f2ddc tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:49.466847 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-b06df27e-c808-4c5c-a12f-693a474f2ddc tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:49.468030 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-b06df27e-c808-4c5c-a12f-693a474f2ddc tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1723 microversion: 2.20 time: 0.278553 Aug 26 00:55:49.468685 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 142/290] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:55:49 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1723 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:55:49.499195 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-ff3699f6-136f-42d3-bdca-1f4b4c42ea4e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:49.503835 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:55:49.510562 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-ff3699f6-136f-42d3-bdca-1f4b4c42ea4e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab" status: 200 len: 1522 microversion: 2.1 time: 0.200374 Aug 26 00:55:49.524348 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 149/291] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:49 2022] GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:55:49.605157 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-b3649cab-9b2a-490c-afd1-3e98a0106261 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:49.611191 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-b3649cab-9b2a-490c-afd1-3e98a0106261 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: c56d5f8c-767e-4fa6-b714-d018853c73bd] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:49.621599 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b3649cab-9b2a-490c-afd1-3e98a0106261 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:49.622092 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b3649cab-9b2a-490c-afd1-3e98a0106261 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:49.622622 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b3649cab-9b2a-490c-afd1-3e98a0106261 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:49.623220 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b3649cab-9b2a-490c-afd1-3e98a0106261 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:49.623755 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b3649cab-9b2a-490c-afd1-3e98a0106261 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:49.624186 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b3649cab-9b2a-490c-afd1-3e98a0106261 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:49.773370 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-b3649cab-9b2a-490c-afd1-3e98a0106261 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93774232c1479aa3e856bffb352140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b49ff217de14a2aae05d524128dec49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:49.796084 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-b3649cab-9b2a-490c-afd1-3e98a0106261 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] 10.222.0.59 "GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd" status: 200 len: 1274 microversion: 2.1 time: 0.194157 Aug 26 00:55:49.798187 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 143/292] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:49 2022] GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd => generated 1274 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:50.518999 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-c66ddb0d-ff9e-4e1a-80b1-7ac9cc8fef76 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:50.520263 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-c66ddb0d-ff9e-4e1a-80b1-7ac9cc8fef76 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:50.537533 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c66ddb0d-ff9e-4e1a-80b1-7ac9cc8fef76 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:50.539709 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c66ddb0d-ff9e-4e1a-80b1-7ac9cc8fef76 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:50.539709 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c66ddb0d-ff9e-4e1a-80b1-7ac9cc8fef76 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:50.540357 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c66ddb0d-ff9e-4e1a-80b1-7ac9cc8fef76 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:50.540989 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c66ddb0d-ff9e-4e1a-80b1-7ac9cc8fef76 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:50.541576 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c66ddb0d-ff9e-4e1a-80b1-7ac9cc8fef76 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:50.557796 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-da49f3c9-4e47-4a8d-babb-9f904c726aba tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:50.558190 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-da49f3c9-4e47-4a8d-babb-9f904c726aba tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:50.568534 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-da49f3c9-4e47-4a8d-babb-9f904c726aba tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:50.571757 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-da49f3c9-4e47-4a8d-babb-9f904c726aba tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:50.572252 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-da49f3c9-4e47-4a8d-babb-9f904c726aba tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:50.574490 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-da49f3c9-4e47-4a8d-babb-9f904c726aba tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:50.575142 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-da49f3c9-4e47-4a8d-babb-9f904c726aba tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:50.575588 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-da49f3c9-4e47-4a8d-babb-9f904c726aba tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:50.747538 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-c66ddb0d-ff9e-4e1a-80b1-7ac9cc8fef76 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:50.755868 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-c66ddb0d-ff9e-4e1a-80b1-7ac9cc8fef76 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:50.757380 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-c66ddb0d-ff9e-4e1a-80b1-7ac9cc8fef76 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:50.759028 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-c66ddb0d-ff9e-4e1a-80b1-7ac9cc8fef76 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1723 microversion: 2.20 time: 0.247629 Aug 26 00:55:50.759592 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 150/293] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:55:50 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1723 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:55:50.818464 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-8775c380-3e83-4aab-8ffe-9c8e5079c077 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:50.819245 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-8775c380-3e83-4aab-8ffe-9c8e5079c077 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: c56d5f8c-767e-4fa6-b714-d018853c73bd] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:50.826881 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8775c380-3e83-4aab-8ffe-9c8e5079c077 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:50.827710 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8775c380-3e83-4aab-8ffe-9c8e5079c077 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:50.829158 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8775c380-3e83-4aab-8ffe-9c8e5079c077 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:50.830684 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8775c380-3e83-4aab-8ffe-9c8e5079c077 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:50.831347 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8775c380-3e83-4aab-8ffe-9c8e5079c077 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:50.831964 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8775c380-3e83-4aab-8ffe-9c8e5079c077 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:50.833779 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-da49f3c9-4e47-4a8d-babb-9f904c726aba tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:50.844112 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-da49f3c9-4e47-4a8d-babb-9f904c726aba tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab" status: 200 len: 1522 microversion: 2.1 time: 0.290193 Aug 26 00:55:50.846391 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 144/294] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:50 2022] GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:55:50.996122 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-8775c380-3e83-4aab-8ffe-9c8e5079c077 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93774232c1479aa3e856bffb352140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b49ff217de14a2aae05d524128dec49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:51.010562 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-8775c380-3e83-4aab-8ffe-9c8e5079c077 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] 10.222.0.59 "GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd" status: 200 len: 1314 microversion: 2.1 time: 0.195732 Aug 26 00:55:51.011939 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 151/295] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:50 2022] GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:55:51.792419 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-4aca9c03-c5b2-44c4-8a7e-911f2c86a827 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:51.793593 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-4aca9c03-c5b2-44c4-8a7e-911f2c86a827 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:51.801874 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4aca9c03-c5b2-44c4-8a7e-911f2c86a827 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:51.802557 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4aca9c03-c5b2-44c4-8a7e-911f2c86a827 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:51.804864 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4aca9c03-c5b2-44c4-8a7e-911f2c86a827 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:51.805894 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4aca9c03-c5b2-44c4-8a7e-911f2c86a827 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:51.806619 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4aca9c03-c5b2-44c4-8a7e-911f2c86a827 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:51.807455 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4aca9c03-c5b2-44c4-8a7e-911f2c86a827 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:51.866257 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-e6faddda-aeff-4579-a768-a771b0eb5075 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:51.866879 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-e6faddda-aeff-4579-a768-a771b0eb5075 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:51.873231 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e6faddda-aeff-4579-a768-a771b0eb5075 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:51.873729 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e6faddda-aeff-4579-a768-a771b0eb5075 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:51.874170 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e6faddda-aeff-4579-a768-a771b0eb5075 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:51.874875 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e6faddda-aeff-4579-a768-a771b0eb5075 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:51.875334 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e6faddda-aeff-4579-a768-a771b0eb5075 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:51.875758 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e6faddda-aeff-4579-a768-a771b0eb5075 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:52.009977 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-4aca9c03-c5b2-44c4-8a7e-911f2c86a827 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:52.027333 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-4aca9c03-c5b2-44c4-8a7e-911f2c86a827 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:52.029968 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-4aca9c03-c5b2-44c4-8a7e-911f2c86a827 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:52.031362 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-4aca9c03-c5b2-44c4-8a7e-911f2c86a827 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1723 microversion: 2.20 time: 0.242943 Aug 26 00:55:52.036394 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 145/296] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:55:51 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1723 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:55:52.042877 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-d2f21540-455a-40be-82aa-e3529f0783a5 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:52.043973 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-d2f21540-455a-40be-82aa-e3529f0783a5 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: c56d5f8c-767e-4fa6-b714-d018853c73bd] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:52.053090 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d2f21540-455a-40be-82aa-e3529f0783a5 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:52.053582 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d2f21540-455a-40be-82aa-e3529f0783a5 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:52.054025 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d2f21540-455a-40be-82aa-e3529f0783a5 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:52.054729 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d2f21540-455a-40be-82aa-e3529f0783a5 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:52.055185 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d2f21540-455a-40be-82aa-e3529f0783a5 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:52.055641 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d2f21540-455a-40be-82aa-e3529f0783a5 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:52.067999 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-e6faddda-aeff-4579-a768-a771b0eb5075 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:52.075953 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-e6faddda-aeff-4579-a768-a771b0eb5075 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab" status: 200 len: 1522 microversion: 2.1 time: 0.213720 Aug 26 00:55:52.080992 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 152/297] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:51 2022] GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:52.232622 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-d2f21540-455a-40be-82aa-e3529f0783a5 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93774232c1479aa3e856bffb352140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b49ff217de14a2aae05d524128dec49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:52.240962 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-d2f21540-455a-40be-82aa-e3529f0783a5 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] 10.222.0.59 "GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd" status: 200 len: 1314 microversion: 2.1 time: 0.201976 Aug 26 00:55:52.241507 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 146/298] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:52 2022] GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:52.324565 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-877927cc-b83a-496d-b651-62e401fff986 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Action: 'create', calling method: .version_select at 0x7f8a92f4ef70>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1867992654", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLXMy/F+jnEekdftpcaE5bnxbkb4oo/W1P5iNQ21iNUKkblFcbXtVCQ6oQxeX4P4Exk/TkmHg3y1SIjkDzaR0g3f9hPRTAEIxT7vS2ca3LSfGfMbOQFNjUeeAY+cTdZf3A=="}} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:55:52.340209 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.quota [None req-877927cc-b83a-496d-b651-62e401fff986 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Getting quotas for project ca3e24d51bdf44c5ad7219fa57d3d23b. Resources: {'key_pairs'} {{(pid=127564) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 00:55:52.344029 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.quota [None req-877927cc-b83a-496d-b651-62e401fff986 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Getting quotas for user cd45f1813efc4926a30454aaa108ac47 and project ca3e24d51bdf44c5ad7219fa57d3d23b. Resources: {'key_pairs'} {{(pid=127564) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 00:55:52.415196 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-877927cc-b83a-496d-b651-62e401fff986 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.303286 Aug 26 00:55:52.415914 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 153/299] 10.222.0.59 () {60 vars in 1159 bytes} [Fri Aug 26 00:55:52 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:55:53.055956 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-1e318e8a-9359-4ee3-8d2b-65fa40151f7b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:53.056510 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-1e318e8a-9359-4ee3-8d2b-65fa40151f7b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:53.063939 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1e318e8a-9359-4ee3-8d2b-65fa40151f7b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:53.064422 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1e318e8a-9359-4ee3-8d2b-65fa40151f7b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:53.065519 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1e318e8a-9359-4ee3-8d2b-65fa40151f7b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:53.066271 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1e318e8a-9359-4ee3-8d2b-65fa40151f7b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:53.066642 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1e318e8a-9359-4ee3-8d2b-65fa40151f7b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:53.067055 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1e318e8a-9359-4ee3-8d2b-65fa40151f7b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:53.094562 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell0:SELECT=2 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:55:53.098679 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-133b8a45-5d55-498a-9da0-3dafa1d31d2a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:53.099287 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-133b8a45-5d55-498a-9da0-3dafa1d31d2a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:53.110919 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-133b8a45-5d55-498a-9da0-3dafa1d31d2a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:53.112434 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-133b8a45-5d55-498a-9da0-3dafa1d31d2a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:53.113182 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-133b8a45-5d55-498a-9da0-3dafa1d31d2a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:53.114444 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-133b8a45-5d55-498a-9da0-3dafa1d31d2a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:53.115163 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-133b8a45-5d55-498a-9da0-3dafa1d31d2a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:53.115820 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-133b8a45-5d55-498a-9da0-3dafa1d31d2a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:53.298016 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-1e318e8a-9359-4ee3-8d2b-65fa40151f7b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:53.316230 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-1e318e8a-9359-4ee3-8d2b-65fa40151f7b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:53.317807 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-1e318e8a-9359-4ee3-8d2b-65fa40151f7b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:53.319050 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-1e318e8a-9359-4ee3-8d2b-65fa40151f7b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1723 microversion: 2.20 time: 0.267321 Aug 26 00:55:53.319692 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 147/300] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:55:53 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1723 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:55:53.336183 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-38e50698-4ccd-4c87-86ff-8a065cbabbae tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:53.344145 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-38e50698-4ccd-4c87-86ff-8a065cbabbae tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: c56d5f8c-767e-4fa6-b714-d018853c73bd] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:53.344145 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-38e50698-4ccd-4c87-86ff-8a065cbabbae tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:53.344145 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-38e50698-4ccd-4c87-86ff-8a065cbabbae tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:53.344747 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-38e50698-4ccd-4c87-86ff-8a065cbabbae tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:53.345074 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-38e50698-4ccd-4c87-86ff-8a065cbabbae tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:53.346282 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-38e50698-4ccd-4c87-86ff-8a065cbabbae tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:53.346914 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-38e50698-4ccd-4c87-86ff-8a065cbabbae tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:53.484214 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-133b8a45-5d55-498a-9da0-3dafa1d31d2a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:53.494900 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-133b8a45-5d55-498a-9da0-3dafa1d31d2a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab" status: 200 len: 1522 microversion: 2.1 time: 0.401048 Aug 26 00:55:53.508079 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-38e50698-4ccd-4c87-86ff-8a065cbabbae tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93774232c1479aa3e856bffb352140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b49ff217de14a2aae05d524128dec49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:53.509389 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 154/301] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:53 2022] GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab => generated 1522 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:55:53.518132 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-38e50698-4ccd-4c87-86ff-8a065cbabbae tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] 10.222.0.59 "GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd" status: 200 len: 1314 microversion: 2.1 time: 0.197169 Aug 26 00:55:53.521432 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 148/302] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:53 2022] GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:54.343215 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-66ee0daa-bd06-4cfe-b3c7-a1958396b9ac tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:54.344363 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-66ee0daa-bd06-4cfe-b3c7-a1958396b9ac tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:54.362626 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-66ee0daa-bd06-4cfe-b3c7-a1958396b9ac tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:54.363320 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-66ee0daa-bd06-4cfe-b3c7-a1958396b9ac tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:54.363923 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-66ee0daa-bd06-4cfe-b3c7-a1958396b9ac tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:54.364730 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-66ee0daa-bd06-4cfe-b3c7-a1958396b9ac tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:54.365640 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-66ee0daa-bd06-4cfe-b3c7-a1958396b9ac tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:54.368136 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-66ee0daa-bd06-4cfe-b3c7-a1958396b9ac tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:54.518731 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-1329c85a-e054-4e59-840a-219409147ca2 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:54.520689 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-1329c85a-e054-4e59-840a-219409147ca2 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:54.524070 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell0:SELECT=4 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:55:54.530571 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1329c85a-e054-4e59-840a-219409147ca2 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:54.531148 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1329c85a-e054-4e59-840a-219409147ca2 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:54.531654 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1329c85a-e054-4e59-840a-219409147ca2 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:54.532508 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1329c85a-e054-4e59-840a-219409147ca2 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:54.533036 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1329c85a-e054-4e59-840a-219409147ca2 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:54.535295 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1329c85a-e054-4e59-840a-219409147ca2 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:54.630855 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-66ee0daa-bd06-4cfe-b3c7-a1958396b9ac tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:54.641450 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-66ee0daa-bd06-4cfe-b3c7-a1958396b9ac tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:54.647453 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-66ee0daa-bd06-4cfe-b3c7-a1958396b9ac tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:54.648784 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-66ee0daa-bd06-4cfe-b3c7-a1958396b9ac tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1723 microversion: 2.20 time: 0.310364 Aug 26 00:55:54.652001 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 155/303] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:55:54 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1723 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:55:54.657248 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-54ffbd1c-4fa2-40c9-8855-2a4a5c7f40ba tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:54.657931 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-54ffbd1c-4fa2-40c9-8855-2a4a5c7f40ba tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: c56d5f8c-767e-4fa6-b714-d018853c73bd] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:54.665110 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-54ffbd1c-4fa2-40c9-8855-2a4a5c7f40ba tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:54.665601 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-54ffbd1c-4fa2-40c9-8855-2a4a5c7f40ba tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:54.666042 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-54ffbd1c-4fa2-40c9-8855-2a4a5c7f40ba tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:54.666744 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-54ffbd1c-4fa2-40c9-8855-2a4a5c7f40ba tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:54.667278 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-54ffbd1c-4fa2-40c9-8855-2a4a5c7f40ba tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:54.667763 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-54ffbd1c-4fa2-40c9-8855-2a4a5c7f40ba tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:54.725771 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-1329c85a-e054-4e59-840a-219409147ca2 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:54.735768 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-1329c85a-e054-4e59-840a-219409147ca2 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab" status: 200 len: 1522 microversion: 2.1 time: 0.220803 Aug 26 00:55:54.737119 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 149/304] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:54 2022] GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:54.743804 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-aa6aff0d-97f6-4cd4-bde9-7aae072998d9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3c73d394-1112-4228-bd36-317f2c2e3363"}} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:55:54.746297 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-aa6aff0d-97f6-4cd4-bde9-7aae072998d9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:54.753335 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-aa6aff0d-97f6-4cd4-bde9-7aae072998d9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:54.754023 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-aa6aff0d-97f6-4cd4-bde9-7aae072998d9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:54.754807 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-aa6aff0d-97f6-4cd4-bde9-7aae072998d9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:54.755851 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-aa6aff0d-97f6-4cd4-bde9-7aae072998d9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:54.756302 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-aa6aff0d-97f6-4cd4-bde9-7aae072998d9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:54.756758 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-aa6aff0d-97f6-4cd4-bde9-7aae072998d9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:54.886022 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-54ffbd1c-4fa2-40c9-8855-2a4a5c7f40ba tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93774232c1479aa3e856bffb352140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b49ff217de14a2aae05d524128dec49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:54.895316 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-54ffbd1c-4fa2-40c9-8855-2a4a5c7f40ba tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] 10.222.0.59 "GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd" status: 200 len: 1314 microversion: 2.1 time: 0.241933 Aug 26 00:55:54.896804 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 156/305] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:54 2022] GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:54.902197 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [req-055642de-80f1-42e0-8149-bd0a002b05fa req-58b9ed87-ce98-4082-9474-c2aeb1783518 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c56d5f8c-767e-4fa6-b714-d018853c73bd", "tag": "03c66732-36bf-4fb0-a82e-c2791f578710"}]} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:55:54.917245 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-055642de-80f1-42e0-8149-bd0a002b05fa req-58b9ed87-ce98-4082-9474-c2aeb1783518 service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:54.917789 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-055642de-80f1-42e0-8149-bd0a002b05fa req-58b9ed87-ce98-4082-9474-c2aeb1783518 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:54.918381 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-055642de-80f1-42e0-8149-bd0a002b05fa req-58b9ed87-ce98-4082-9474-c2aeb1783518 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:54.938467 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.compute.server_external_events [req-055642de-80f1-42e0-8149-bd0a002b05fa req-58b9ed87-ce98-4082-9474-c2aeb1783518 service nova] Creating event network-changed:03c66732-36bf-4fb0-a82e-c2791f578710 for instance c56d5f8c-767e-4fa6-b714-d018853c73bd on hv-cinder-83538 Aug 26 00:55:54.944723 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [req-055642de-80f1-42e0-8149-bd0a002b05fa req-58b9ed87-ce98-4082-9474-c2aeb1783518 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046188 Aug 26 00:55:54.946086 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 157/306] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 00:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:55:55.601517 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-aa6aff0d-97f6-4cd4-bde9-7aae072998d9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "POST /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.863559 Aug 26 00:55:55.603165 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 150/307] 10.222.0.59 () {60 vars in 1323 bytes} [Fri Aug 26 00:55:54 2022] POST /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7/os-volume_attachments => generated 194 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:55:55.682456 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-51e94d30-83a1-43d2-bb3d-0d055cde2048 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:55.684214 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-51e94d30-83a1-43d2-bb3d-0d055cde2048 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:55.697833 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-51e94d30-83a1-43d2-bb3d-0d055cde2048 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:55.698598 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-51e94d30-83a1-43d2-bb3d-0d055cde2048 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:55.699122 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-51e94d30-83a1-43d2-bb3d-0d055cde2048 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:55.699928 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-51e94d30-83a1-43d2-bb3d-0d055cde2048 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:55.700466 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-51e94d30-83a1-43d2-bb3d-0d055cde2048 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:55.700978 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-51e94d30-83a1-43d2-bb3d-0d055cde2048 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:55.760287 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-15589845-b668-4182-8882-9547a0333298 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:55.762971 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-15589845-b668-4182-8882-9547a0333298 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:55.782247 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-15589845-b668-4182-8882-9547a0333298 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:55.788670 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-15589845-b668-4182-8882-9547a0333298 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:55.789213 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-15589845-b668-4182-8882-9547a0333298 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:55.789960 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-15589845-b668-4182-8882-9547a0333298 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:55.790421 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-15589845-b668-4182-8882-9547a0333298 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:55.790846 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-15589845-b668-4182-8882-9547a0333298 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:55.916302 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-51e94d30-83a1-43d2-bb3d-0d055cde2048 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:55.931850 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-51e94d30-83a1-43d2-bb3d-0d055cde2048 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:55.934090 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-51e94d30-83a1-43d2-bb3d-0d055cde2048 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:55.935645 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-51e94d30-83a1-43d2-bb3d-0d055cde2048 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1723 microversion: 2.20 time: 0.259177 Aug 26 00:55:55.936982 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 158/308] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:55:55 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1723 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:55:55.944231 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-95ff9218-fb18-4f78-9293-03c708a92ff3 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:55.945787 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-95ff9218-fb18-4f78-9293-03c708a92ff3 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: c56d5f8c-767e-4fa6-b714-d018853c73bd] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:55.956011 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-95ff9218-fb18-4f78-9293-03c708a92ff3 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:55.956876 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-95ff9218-fb18-4f78-9293-03c708a92ff3 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:55.958334 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-95ff9218-fb18-4f78-9293-03c708a92ff3 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:55.963156 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-95ff9218-fb18-4f78-9293-03c708a92ff3 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:55.963156 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-95ff9218-fb18-4f78-9293-03c708a92ff3 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:55.963156 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-95ff9218-fb18-4f78-9293-03c708a92ff3 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:55.989235 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-15589845-b668-4182-8882-9547a0333298 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:55.997716 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-15589845-b668-4182-8882-9547a0333298 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab" status: 200 len: 1522 microversion: 2.1 time: 0.244086 Aug 26 00:55:55.999275 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 151/309] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:55 2022] GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:56.116872 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-95ff9218-fb18-4f78-9293-03c708a92ff3 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93774232c1479aa3e856bffb352140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b49ff217de14a2aae05d524128dec49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:56.124662 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-95ff9218-fb18-4f78-9293-03c708a92ff3 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] 10.222.0.59 "GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd" status: 200 len: 1314 microversion: 2.1 time: 0.186256 Aug 26 00:55:56.125237 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 159/310] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:55 2022] GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:55:56.961335 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-2f2fd6af-4796-4882-a80a-d8ae9c42e760 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:56.961843 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-2f2fd6af-4796-4882-a80a-d8ae9c42e760 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:56.968209 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2f2fd6af-4796-4882-a80a-d8ae9c42e760 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:56.968738 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2f2fd6af-4796-4882-a80a-d8ae9c42e760 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:56.969166 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2f2fd6af-4796-4882-a80a-d8ae9c42e760 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:56.969837 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2f2fd6af-4796-4882-a80a-d8ae9c42e760 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:56.970276 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2f2fd6af-4796-4882-a80a-d8ae9c42e760 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:56.970689 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2f2fd6af-4796-4882-a80a-d8ae9c42e760 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:57.020696 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-460623c6-c49c-4555-abdc-d3b025062fa5 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:57.021306 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-460623c6-c49c-4555-abdc-d3b025062fa5 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:57.027325 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-460623c6-c49c-4555-abdc-d3b025062fa5 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:57.027805 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-460623c6-c49c-4555-abdc-d3b025062fa5 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:57.028239 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-460623c6-c49c-4555-abdc-d3b025062fa5 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:57.028980 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-460623c6-c49c-4555-abdc-d3b025062fa5 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:57.029430 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-460623c6-c49c-4555-abdc-d3b025062fa5 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:57.029856 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-460623c6-c49c-4555-abdc-d3b025062fa5 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:57.101109 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-2f2fd6af-4796-4882-a80a-d8ae9c42e760 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:57.109266 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-2f2fd6af-4796-4882-a80a-d8ae9c42e760 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:57.110705 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-2f2fd6af-4796-4882-a80a-d8ae9c42e760 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:57.112534 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-2f2fd6af-4796-4882-a80a-d8ae9c42e760 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1723 microversion: 2.20 time: 0.155106 Aug 26 00:55:57.113051 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 152/311] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:55:56 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:55:57.153520 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-adcc5076-de6a-4e02-b58f-6b794494ffa9 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:57.154136 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-adcc5076-de6a-4e02-b58f-6b794494ffa9 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: c56d5f8c-767e-4fa6-b714-d018853c73bd] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:57.160756 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-adcc5076-de6a-4e02-b58f-6b794494ffa9 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:57.161244 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-adcc5076-de6a-4e02-b58f-6b794494ffa9 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:57.161675 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-adcc5076-de6a-4e02-b58f-6b794494ffa9 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:57.162378 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-460623c6-c49c-4555-abdc-d3b025062fa5 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:57.162624 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-adcc5076-de6a-4e02-b58f-6b794494ffa9 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:57.163071 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-adcc5076-de6a-4e02-b58f-6b794494ffa9 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:57.163491 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-adcc5076-de6a-4e02-b58f-6b794494ffa9 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:57.170110 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-460623c6-c49c-4555-abdc-d3b025062fa5 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab" status: 200 len: 1522 microversion: 2.1 time: 0.153481 Aug 26 00:55:57.170782 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 160/312] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:57 2022] GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:55:57.297650 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-adcc5076-de6a-4e02-b58f-6b794494ffa9 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93774232c1479aa3e856bffb352140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b49ff217de14a2aae05d524128dec49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:57.307030 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-adcc5076-de6a-4e02-b58f-6b794494ffa9 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] 10.222.0.59 "GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd" status: 200 len: 1314 microversion: 2.1 time: 0.157235 Aug 26 00:55:57.307595 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 153/313] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:57 2022] GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:55:58.135240 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-37110294-b917-4b8a-a4e4-cbf16f3ce777 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:58.135866 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-37110294-b917-4b8a-a4e4-cbf16f3ce777 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:58.141935 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-37110294-b917-4b8a-a4e4-cbf16f3ce777 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:58.142414 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-37110294-b917-4b8a-a4e4-cbf16f3ce777 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:58.142872 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-37110294-b917-4b8a-a4e4-cbf16f3ce777 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:58.143556 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-37110294-b917-4b8a-a4e4-cbf16f3ce777 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:58.144008 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-37110294-b917-4b8a-a4e4-cbf16f3ce777 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:58.144433 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-37110294-b917-4b8a-a4e4-cbf16f3ce777 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:58.191649 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-b6a1a9d3-ae1f-49aa-80a1-82e64926651b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:58.192239 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-b6a1a9d3-ae1f-49aa-80a1-82e64926651b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:58.198550 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b6a1a9d3-ae1f-49aa-80a1-82e64926651b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:58.199023 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b6a1a9d3-ae1f-49aa-80a1-82e64926651b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:58.199450 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b6a1a9d3-ae1f-49aa-80a1-82e64926651b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:58.200131 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b6a1a9d3-ae1f-49aa-80a1-82e64926651b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:58.200600 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b6a1a9d3-ae1f-49aa-80a1-82e64926651b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:58.201020 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b6a1a9d3-ae1f-49aa-80a1-82e64926651b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:58.278164 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-37110294-b917-4b8a-a4e4-cbf16f3ce777 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:58.286573 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-37110294-b917-4b8a-a4e4-cbf16f3ce777 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:58.288190 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-37110294-b917-4b8a-a4e4-cbf16f3ce777 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:58.289543 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-37110294-b917-4b8a-a4e4-cbf16f3ce777 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1723 microversion: 2.20 time: 0.158094 Aug 26 00:55:58.290271 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 161/314] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:55:58 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:55:58.327028 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-5a6b34ef-b2e8-4958-9320-2b9f47fb1271 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:58.327741 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-5a6b34ef-b2e8-4958-9320-2b9f47fb1271 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: c56d5f8c-767e-4fa6-b714-d018853c73bd] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:58.328671 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-b6a1a9d3-ae1f-49aa-80a1-82e64926651b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:58.333920 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5a6b34ef-b2e8-4958-9320-2b9f47fb1271 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:58.334472 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5a6b34ef-b2e8-4958-9320-2b9f47fb1271 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:58.334902 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5a6b34ef-b2e8-4958-9320-2b9f47fb1271 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:58.335578 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5a6b34ef-b2e8-4958-9320-2b9f47fb1271 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:58.336020 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5a6b34ef-b2e8-4958-9320-2b9f47fb1271 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:58.336383 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-b6a1a9d3-ae1f-49aa-80a1-82e64926651b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab" status: 200 len: 1522 microversion: 2.1 time: 0.149172 Aug 26 00:55:58.336508 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5a6b34ef-b2e8-4958-9320-2b9f47fb1271 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:58.336977 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 154/315] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:58 2022] GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:55:58.465007 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-5a6b34ef-b2e8-4958-9320-2b9f47fb1271 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93774232c1479aa3e856bffb352140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b49ff217de14a2aae05d524128dec49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:58.473132 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-5a6b34ef-b2e8-4958-9320-2b9f47fb1271 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] 10.222.0.59 "GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd" status: 200 len: 1314 microversion: 2.1 time: 0.149998 Aug 26 00:55:58.473682 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 162/316] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:58 2022] GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:55:59.312987 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-44abc9aa-c448-43cb-bb14-5b5ae9a002f9 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:59.313599 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-44abc9aa-c448-43cb-bb14-5b5ae9a002f9 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:59.320510 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-44abc9aa-c448-43cb-bb14-5b5ae9a002f9 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:59.321004 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-44abc9aa-c448-43cb-bb14-5b5ae9a002f9 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:59.321442 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-44abc9aa-c448-43cb-bb14-5b5ae9a002f9 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:59.322126 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-44abc9aa-c448-43cb-bb14-5b5ae9a002f9 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:59.322582 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-44abc9aa-c448-43cb-bb14-5b5ae9a002f9 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:59.323008 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-44abc9aa-c448-43cb-bb14-5b5ae9a002f9 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:59.342267 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:55:59.357284 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-8a9c1215-2b25-4bd0-92ef-b945a2196c03 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:59.358065 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-8a9c1215-2b25-4bd0-92ef-b945a2196c03 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:59.364090 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8a9c1215-2b25-4bd0-92ef-b945a2196c03 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:59.364614 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8a9c1215-2b25-4bd0-92ef-b945a2196c03 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:59.365053 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8a9c1215-2b25-4bd0-92ef-b945a2196c03 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:59.365896 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8a9c1215-2b25-4bd0-92ef-b945a2196c03 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:59.366351 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8a9c1215-2b25-4bd0-92ef-b945a2196c03 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:59.366778 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8a9c1215-2b25-4bd0-92ef-b945a2196c03 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:59.464913 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-44abc9aa-c448-43cb-bb14-5b5ae9a002f9 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:59.473261 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-44abc9aa-c448-43cb-bb14-5b5ae9a002f9 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:59.474696 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-44abc9aa-c448-43cb-bb14-5b5ae9a002f9 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:59.475847 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-44abc9aa-c448-43cb-bb14-5b5ae9a002f9 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1723 microversion: 2.20 time: 0.166926 Aug 26 00:55:59.476395 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 155/317] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:55:59 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:55:59.496917 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-8a3e7e98-b66e-416f-842e-d19af11d3a0b tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:55:59.498013 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-8a3e7e98-b66e-416f-842e-d19af11d3a0b tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: c56d5f8c-767e-4fa6-b714-d018853c73bd] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:55:59.507530 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8a3e7e98-b66e-416f-842e-d19af11d3a0b tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:59.508013 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8a3e7e98-b66e-416f-842e-d19af11d3a0b tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:59.508452 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8a3e7e98-b66e-416f-842e-d19af11d3a0b tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:59.509174 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8a3e7e98-b66e-416f-842e-d19af11d3a0b tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:55:59.509687 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8a3e7e98-b66e-416f-842e-d19af11d3a0b tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:55:59.510110 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8a3e7e98-b66e-416f-842e-d19af11d3a0b tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:55:59.511525 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-8a9c1215-2b25-4bd0-92ef-b945a2196c03 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:59.519894 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-8a9c1215-2b25-4bd0-92ef-b945a2196c03 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab" status: 200 len: 1522 microversion: 2.1 time: 0.166437 Aug 26 00:55:59.520587 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 163/318] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:59 2022] GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:55:59.649443 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-8a3e7e98-b66e-416f-842e-d19af11d3a0b tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93774232c1479aa3e856bffb352140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b49ff217de14a2aae05d524128dec49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:55:59.657295 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-8a3e7e98-b66e-416f-842e-d19af11d3a0b tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] 10.222.0.59 "GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd" status: 200 len: 1314 microversion: 2.1 time: 0.167888 Aug 26 00:55:59.658298 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 156/319] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:55:59 2022] GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:56:00.498281 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-401df9f2-64f3-49f2-9190-1b244dffc3f5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:00.498893 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-401df9f2-64f3-49f2-9190-1b244dffc3f5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:00.505293 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-401df9f2-64f3-49f2-9190-1b244dffc3f5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:00.505783 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-401df9f2-64f3-49f2-9190-1b244dffc3f5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:00.506225 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-401df9f2-64f3-49f2-9190-1b244dffc3f5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:00.506950 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-401df9f2-64f3-49f2-9190-1b244dffc3f5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:00.507406 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-401df9f2-64f3-49f2-9190-1b244dffc3f5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:00.514307 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-401df9f2-64f3-49f2-9190-1b244dffc3f5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:00.543101 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-03181cb4-98e6-4d0c-94b7-a45272bf6fc7 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:00.543864 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-03181cb4-98e6-4d0c-94b7-a45272bf6fc7 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:00.550456 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-03181cb4-98e6-4d0c-94b7-a45272bf6fc7 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:00.551462 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-03181cb4-98e6-4d0c-94b7-a45272bf6fc7 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:00.552077 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-03181cb4-98e6-4d0c-94b7-a45272bf6fc7 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:00.552815 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-03181cb4-98e6-4d0c-94b7-a45272bf6fc7 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:00.553272 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-03181cb4-98e6-4d0c-94b7-a45272bf6fc7 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:00.553742 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-03181cb4-98e6-4d0c-94b7-a45272bf6fc7 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:00.671487 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-401df9f2-64f3-49f2-9190-1b244dffc3f5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:00.688783 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-401df9f2-64f3-49f2-9190-1b244dffc3f5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:00.690194 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-401df9f2-64f3-49f2-9190-1b244dffc3f5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:00.692171 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-401df9f2-64f3-49f2-9190-1b244dffc3f5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1723 microversion: 2.20 time: 0.197763 Aug 26 00:56:00.692786 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 164/320] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:56:00 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1723 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:56:00.697562 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-16455e13-d423-444a-be26-682e93b9e227 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:00.698486 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-16455e13-d423-444a-be26-682e93b9e227 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: c56d5f8c-767e-4fa6-b714-d018853c73bd] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:00.711357 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-16455e13-d423-444a-be26-682e93b9e227 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:00.711888 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-16455e13-d423-444a-be26-682e93b9e227 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:00.712325 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-16455e13-d423-444a-be26-682e93b9e227 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:00.713368 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-16455e13-d423-444a-be26-682e93b9e227 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:00.713822 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-16455e13-d423-444a-be26-682e93b9e227 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:00.714249 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-16455e13-d423-444a-be26-682e93b9e227 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:00.718302 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-03181cb4-98e6-4d0c-94b7-a45272bf6fc7 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:00.730710 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-03181cb4-98e6-4d0c-94b7-a45272bf6fc7 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab" status: 200 len: 1522 microversion: 2.1 time: 0.192981 Aug 26 00:56:00.731897 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 157/321] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:00 2022] GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:56:00.865977 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-16455e13-d423-444a-be26-682e93b9e227 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93774232c1479aa3e856bffb352140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b49ff217de14a2aae05d524128dec49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:00.874731 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-16455e13-d423-444a-be26-682e93b9e227 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] 10.222.0.59 "GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd" status: 200 len: 1314 microversion: 2.1 time: 0.180688 Aug 26 00:56:00.875288 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 165/322] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:00 2022] GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:01.718323 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-2470e822-1613-4b41-a66e-b86291ae15da tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:01.718856 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-2470e822-1613-4b41-a66e-b86291ae15da tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:01.726314 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2470e822-1613-4b41-a66e-b86291ae15da tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:01.726816 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2470e822-1613-4b41-a66e-b86291ae15da tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:01.727250 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2470e822-1613-4b41-a66e-b86291ae15da tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:01.727987 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2470e822-1613-4b41-a66e-b86291ae15da tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:01.728430 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2470e822-1613-4b41-a66e-b86291ae15da tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:01.733068 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2470e822-1613-4b41-a66e-b86291ae15da tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:01.753769 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-ef17e528-9dc1-4bf9-9ef7-c65330243192 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:01.754386 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-ef17e528-9dc1-4bf9-9ef7-c65330243192 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:01.760787 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ef17e528-9dc1-4bf9-9ef7-c65330243192 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:01.761277 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ef17e528-9dc1-4bf9-9ef7-c65330243192 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:01.766044 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ef17e528-9dc1-4bf9-9ef7-c65330243192 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:01.766044 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ef17e528-9dc1-4bf9-9ef7-c65330243192 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:01.766044 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ef17e528-9dc1-4bf9-9ef7-c65330243192 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:01.766044 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ef17e528-9dc1-4bf9-9ef7-c65330243192 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:01.906545 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-ef17e528-9dc1-4bf9-9ef7-c65330243192 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:01.917683 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-ef17e528-9dc1-4bf9-9ef7-c65330243192 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab" status: 200 len: 1522 microversion: 2.1 time: 0.167444 Aug 26 00:56:01.920858 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 166/323] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:01 2022] GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:01.928559 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-b1ebd114-4ea7-4b6b-b764-5345cbee1d17 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:01.929597 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-b1ebd114-4ea7-4b6b-b764-5345cbee1d17 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: c56d5f8c-767e-4fa6-b714-d018853c73bd] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:01.942114 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b1ebd114-4ea7-4b6b-b764-5345cbee1d17 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:01.945710 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b1ebd114-4ea7-4b6b-b764-5345cbee1d17 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:01.945710 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b1ebd114-4ea7-4b6b-b764-5345cbee1d17 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:01.945710 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b1ebd114-4ea7-4b6b-b764-5345cbee1d17 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:01.945710 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b1ebd114-4ea7-4b6b-b764-5345cbee1d17 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:01.946065 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b1ebd114-4ea7-4b6b-b764-5345cbee1d17 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:02.102680 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-2470e822-1613-4b41-a66e-b86291ae15da tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:02.108748 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-b1ebd114-4ea7-4b6b-b764-5345cbee1d17 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93774232c1479aa3e856bffb352140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b49ff217de14a2aae05d524128dec49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:02.118710 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-b1ebd114-4ea7-4b6b-b764-5345cbee1d17 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] 10.222.0.59 "GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd" status: 200 len: 1314 microversion: 2.1 time: 0.196287 Aug 26 00:56:02.124979 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 167/324] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:01 2022] GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:02.125217 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-2470e822-1613-4b41-a66e-b86291ae15da tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:02.125217 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-2470e822-1613-4b41-a66e-b86291ae15da tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:02.125217 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-2470e822-1613-4b41-a66e-b86291ae15da tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1723 microversion: 2.20 time: 0.410600 Aug 26 00:56:02.136900 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 158/325] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:56:01 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1723 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:56:02.538648 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [req-4b503365-6be2-4c6d-8400-26a4770d7ebd req-06927873-55e1-49dc-92fe-8619daa2a6f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c56d5f8c-767e-4fa6-b714-d018853c73bd", "name": "network-vif-plugged", "status": "completed", "tag": "03c66732-36bf-4fb0-a82e-c2791f578710"}]} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:56:02.538648 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell0:SELECT=10 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:56:02.540989 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-4b503365-6be2-4c6d-8400-26a4770d7ebd req-06927873-55e1-49dc-92fe-8619daa2a6f3 service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:02.541455 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-4b503365-6be2-4c6d-8400-26a4770d7ebd req-06927873-55e1-49dc-92fe-8619daa2a6f3 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:02.541876 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-4b503365-6be2-4c6d-8400-26a4770d7ebd req-06927873-55e1-49dc-92fe-8619daa2a6f3 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:02.545514 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell1:SELECT=100 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:56:02.554419 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.compute.server_external_events [req-4b503365-6be2-4c6d-8400-26a4770d7ebd req-06927873-55e1-49dc-92fe-8619daa2a6f3 service nova] Creating event network-vif-plugged:03c66732-36bf-4fb0-a82e-c2791f578710 for instance c56d5f8c-767e-4fa6-b714-d018853c73bd on hv-cinder-83538 Aug 26 00:56:02.558651 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [req-4b503365-6be2-4c6d-8400-26a4770d7ebd req-06927873-55e1-49dc-92fe-8619daa2a6f3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031854 Aug 26 00:56:02.559459 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 168/326] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 00:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:56:02.945908 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-6cd6fc0c-cc6b-4b46-9712-e1b819399629 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:02.946517 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-6cd6fc0c-cc6b-4b46-9712-e1b819399629 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:02.953106 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6cd6fc0c-cc6b-4b46-9712-e1b819399629 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:02.953588 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6cd6fc0c-cc6b-4b46-9712-e1b819399629 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:02.954022 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6cd6fc0c-cc6b-4b46-9712-e1b819399629 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:02.954735 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6cd6fc0c-cc6b-4b46-9712-e1b819399629 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:02.955369 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6cd6fc0c-cc6b-4b46-9712-e1b819399629 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:02.955791 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6cd6fc0c-cc6b-4b46-9712-e1b819399629 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:03.110164 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-6cd6fc0c-cc6b-4b46-9712-e1b819399629 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:03.118829 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-6cd6fc0c-cc6b-4b46-9712-e1b819399629 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab" status: 200 len: 1522 microversion: 2.1 time: 0.176707 Aug 26 00:56:03.119388 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 159/327] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:02 2022] GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:03.140028 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-12cb0ef7-5292-47ec-82a0-860acd51a231 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:03.140775 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-12cb0ef7-5292-47ec-82a0-860acd51a231 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: c56d5f8c-767e-4fa6-b714-d018853c73bd] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:03.148048 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-12cb0ef7-5292-47ec-82a0-860acd51a231 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:03.148791 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-12cb0ef7-5292-47ec-82a0-860acd51a231 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:03.149218 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-12cb0ef7-5292-47ec-82a0-860acd51a231 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:03.150235 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-12cb0ef7-5292-47ec-82a0-860acd51a231 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:03.150694 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-12cb0ef7-5292-47ec-82a0-860acd51a231 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:03.151110 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-12cb0ef7-5292-47ec-82a0-860acd51a231 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:03.152718 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-9a1b3253-3d08-40a6-9c52-9a978f226d8a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:03.153341 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-9a1b3253-3d08-40a6-9c52-9a978f226d8a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:03.160316 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9a1b3253-3d08-40a6-9c52-9a978f226d8a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:03.160846 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9a1b3253-3d08-40a6-9c52-9a978f226d8a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:03.161287 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9a1b3253-3d08-40a6-9c52-9a978f226d8a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:03.174396 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9a1b3253-3d08-40a6-9c52-9a978f226d8a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:03.175155 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9a1b3253-3d08-40a6-9c52-9a978f226d8a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:03.175457 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9a1b3253-3d08-40a6-9c52-9a978f226d8a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:03.306574 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-12cb0ef7-5292-47ec-82a0-860acd51a231 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93774232c1479aa3e856bffb352140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b49ff217de14a2aae05d524128dec49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:03.314224 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-12cb0ef7-5292-47ec-82a0-860acd51a231 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] 10.222.0.59 "GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd" status: 200 len: 1314 microversion: 2.1 time: 0.178906 Aug 26 00:56:03.326912 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 169/328] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:03 2022] GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:03.349109 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-9a1b3253-3d08-40a6-9c52-9a978f226d8a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:03.357526 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-9a1b3253-3d08-40a6-9c52-9a978f226d8a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:03.358986 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-9a1b3253-3d08-40a6-9c52-9a978f226d8a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:03.360197 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-9a1b3253-3d08-40a6-9c52-9a978f226d8a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1723 microversion: 2.20 time: 0.214038 Aug 26 00:56:03.360791 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 160/329] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:56:03 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 00:56:04.140814 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-30787386-1f15-471e-a4ef-188964375977 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:04.141437 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-30787386-1f15-471e-a4ef-188964375977 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:04.147498 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-30787386-1f15-471e-a4ef-188964375977 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:04.147985 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-30787386-1f15-471e-a4ef-188964375977 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:04.148415 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-30787386-1f15-471e-a4ef-188964375977 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:04.149133 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-30787386-1f15-471e-a4ef-188964375977 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:04.149582 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-30787386-1f15-471e-a4ef-188964375977 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:04.150004 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-30787386-1f15-471e-a4ef-188964375977 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:04.295099 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-30787386-1f15-471e-a4ef-188964375977 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:04.303850 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-30787386-1f15-471e-a4ef-188964375977 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab" status: 200 len: 1522 microversion: 2.1 time: 0.167085 Aug 26 00:56:04.304810 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 170/330] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:04 2022] GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:04.334597 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-c404ed72-28ab-4a04-9878-b6e191ffeaf0 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:04.335422 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-c404ed72-28ab-4a04-9878-b6e191ffeaf0 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: c56d5f8c-767e-4fa6-b714-d018853c73bd] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:04.342231 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c404ed72-28ab-4a04-9878-b6e191ffeaf0 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:04.342733 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c404ed72-28ab-4a04-9878-b6e191ffeaf0 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:04.343239 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c404ed72-28ab-4a04-9878-b6e191ffeaf0 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:04.344000 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c404ed72-28ab-4a04-9878-b6e191ffeaf0 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:04.344680 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c404ed72-28ab-4a04-9878-b6e191ffeaf0 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:04.345113 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c404ed72-28ab-4a04-9878-b6e191ffeaf0 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:04.393228 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-2dda11d9-14be-4345-b05a-4d306e7d11bf tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:04.393758 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-2dda11d9-14be-4345-b05a-4d306e7d11bf tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:04.406527 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2dda11d9-14be-4345-b05a-4d306e7d11bf tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:04.407507 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2dda11d9-14be-4345-b05a-4d306e7d11bf tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:04.408090 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2dda11d9-14be-4345-b05a-4d306e7d11bf tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:04.409458 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2dda11d9-14be-4345-b05a-4d306e7d11bf tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:04.410393 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2dda11d9-14be-4345-b05a-4d306e7d11bf tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:04.410963 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2dda11d9-14be-4345-b05a-4d306e7d11bf tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:04.494603 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-c404ed72-28ab-4a04-9878-b6e191ffeaf0 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93774232c1479aa3e856bffb352140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b49ff217de14a2aae05d524128dec49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:04.502698 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-c404ed72-28ab-4a04-9878-b6e191ffeaf0 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] 10.222.0.59 "GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd" status: 200 len: 1314 microversion: 2.1 time: 0.172117 Aug 26 00:56:04.510111 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 161/331] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:04 2022] GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:04.565823 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-2dda11d9-14be-4345-b05a-4d306e7d11bf tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:04.574995 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-2dda11d9-14be-4345-b05a-4d306e7d11bf tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:04.576506 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-2dda11d9-14be-4345-b05a-4d306e7d11bf tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:04.577675 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-2dda11d9-14be-4345-b05a-4d306e7d11bf tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1723 microversion: 2.20 time: 0.197650 Aug 26 00:56:04.578211 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 171/332] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:56:04 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1723 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 00:56:05.326137 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-11506334-823a-42de-a8a7-bb0927142cce tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:05.326966 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-11506334-823a-42de-a8a7-bb0927142cce tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:05.334245 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-11506334-823a-42de-a8a7-bb0927142cce tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:05.334938 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-11506334-823a-42de-a8a7-bb0927142cce tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:05.336004 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-11506334-823a-42de-a8a7-bb0927142cce tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:05.336901 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-11506334-823a-42de-a8a7-bb0927142cce tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:05.338300 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-11506334-823a-42de-a8a7-bb0927142cce tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:05.338872 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-11506334-823a-42de-a8a7-bb0927142cce tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:05.487111 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-11506334-823a-42de-a8a7-bb0927142cce tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:05.494760 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-11506334-823a-42de-a8a7-bb0927142cce tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab" status: 200 len: 1522 microversion: 2.1 time: 0.172323 Aug 26 00:56:05.495322 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 162/333] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:05 2022] GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:05.530099 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-c5f31324-7c1d-4691-a2a7-d951f6828fac tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:05.530656 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-c5f31324-7c1d-4691-a2a7-d951f6828fac tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: c56d5f8c-767e-4fa6-b714-d018853c73bd] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:05.537535 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c5f31324-7c1d-4691-a2a7-d951f6828fac tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:05.541763 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c5f31324-7c1d-4691-a2a7-d951f6828fac tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:05.541763 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c5f31324-7c1d-4691-a2a7-d951f6828fac tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:05.541763 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c5f31324-7c1d-4691-a2a7-d951f6828fac tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:05.541763 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c5f31324-7c1d-4691-a2a7-d951f6828fac tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:05.542126 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c5f31324-7c1d-4691-a2a7-d951f6828fac tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:05.602326 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-ecf98397-d4b4-42e4-a494-a9e19c3753f8 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:05.603970 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-ecf98397-d4b4-42e4-a494-a9e19c3753f8 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:05.610983 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ecf98397-d4b4-42e4-a494-a9e19c3753f8 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:05.612112 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ecf98397-d4b4-42e4-a494-a9e19c3753f8 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:05.612565 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ecf98397-d4b4-42e4-a494-a9e19c3753f8 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:05.613300 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ecf98397-d4b4-42e4-a494-a9e19c3753f8 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:05.613747 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ecf98397-d4b4-42e4-a494-a9e19c3753f8 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:05.614161 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ecf98397-d4b4-42e4-a494-a9e19c3753f8 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:05.690297 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-c5f31324-7c1d-4691-a2a7-d951f6828fac tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93774232c1479aa3e856bffb352140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b49ff217de14a2aae05d524128dec49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:05.698488 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-c5f31324-7c1d-4691-a2a7-d951f6828fac tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] 10.222.0.59 "GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd" status: 200 len: 1498 microversion: 2.1 time: 0.172319 Aug 26 00:56:05.699049 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 172/334] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:05 2022] GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd => generated 1498 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:05.753633 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-ecf98397-d4b4-42e4-a494-a9e19c3753f8 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:05.762515 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-ecf98397-d4b4-42e4-a494-a9e19c3753f8 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:05.764871 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-ecf98397-d4b4-42e4-a494-a9e19c3753f8 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:05.766361 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-ecf98397-d4b4-42e4-a494-a9e19c3753f8 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1723 microversion: 2.20 time: 0.168832 Aug 26 00:56:05.766923 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 163/335] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:56:05 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:56:06.524386 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-c5cf9c40-0f18-48a4-846e-dec85130a4d2 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:06.525024 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-c5cf9c40-0f18-48a4-846e-dec85130a4d2 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:06.531142 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c5cf9c40-0f18-48a4-846e-dec85130a4d2 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:06.531737 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c5cf9c40-0f18-48a4-846e-dec85130a4d2 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:06.532086 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c5cf9c40-0f18-48a4-846e-dec85130a4d2 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:06.532820 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c5cf9c40-0f18-48a4-846e-dec85130a4d2 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:06.533458 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c5cf9c40-0f18-48a4-846e-dec85130a4d2 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:06.533883 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c5cf9c40-0f18-48a4-846e-dec85130a4d2 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:06.671265 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-c5cf9c40-0f18-48a4-846e-dec85130a4d2 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:06.679598 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-c5cf9c40-0f18-48a4-846e-dec85130a4d2 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab" status: 200 len: 1522 microversion: 2.1 time: 0.159134 Aug 26 00:56:06.680161 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 173/336] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:06 2022] GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:06.791809 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-38291bec-abce-4b8b-af9c-c5d40d922752 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:06.792420 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-38291bec-abce-4b8b-af9c-c5d40d922752 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:06.798569 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-38291bec-abce-4b8b-af9c-c5d40d922752 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:06.803228 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-38291bec-abce-4b8b-af9c-c5d40d922752 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:06.803228 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-38291bec-abce-4b8b-af9c-c5d40d922752 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:06.803228 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-38291bec-abce-4b8b-af9c-c5d40d922752 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:06.803228 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-38291bec-abce-4b8b-af9c-c5d40d922752 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:06.803585 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-38291bec-abce-4b8b-af9c-c5d40d922752 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:06.943673 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-38291bec-abce-4b8b-af9c-c5d40d922752 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:06.955156 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-38291bec-abce-4b8b-af9c-c5d40d922752 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:06.956700 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-38291bec-abce-4b8b-af9c-c5d40d922752 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:06.957856 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-38291bec-abce-4b8b-af9c-c5d40d922752 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1723 microversion: 2.20 time: 0.171118 Aug 26 00:56:06.964308 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 164/337] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:56:06 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:56:07.008840 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-747ccb23-da11-4462-bc15-c8e1cf05da0e tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:07.009337 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-747ccb23-da11-4462-bc15-c8e1cf05da0e tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: c56d5f8c-767e-4fa6-b714-d018853c73bd] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:07.015553 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-747ccb23-da11-4462-bc15-c8e1cf05da0e tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:07.016044 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-747ccb23-da11-4462-bc15-c8e1cf05da0e tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:07.016508 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-747ccb23-da11-4462-bc15-c8e1cf05da0e tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:07.017208 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-747ccb23-da11-4462-bc15-c8e1cf05da0e tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:07.017788 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-747ccb23-da11-4462-bc15-c8e1cf05da0e tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:07.018219 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-747ccb23-da11-4462-bc15-c8e1cf05da0e tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:07.044923 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-747ccb23-da11-4462-bc15-c8e1cf05da0e tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: c56d5f8c-767e-4fa6-b714-d018853c73bd] Going to try to terminate instance {{(pid=127564) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 00:56:07.442047 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-747ccb23-da11-4462-bc15-c8e1cf05da0e tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] 10.222.0.59 "DELETE /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd" status: 204 len: 0 microversion: 2.1 time: 0.436738 Aug 26 00:56:07.442645 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 174/338] 10.222.0.59 () {58 vars in 1239 bytes} [Fri Aug 26 00:56:07 2022] DELETE /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd => generated 0 bytes in 438 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 00:56:07.450531 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-d9ef43da-9708-4d50-8365-847c142de85f tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:07.451157 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-d9ef43da-9708-4d50-8365-847c142de85f tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: c56d5f8c-767e-4fa6-b714-d018853c73bd] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:07.461058 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d9ef43da-9708-4d50-8365-847c142de85f tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:07.461576 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d9ef43da-9708-4d50-8365-847c142de85f tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:07.462724 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d9ef43da-9708-4d50-8365-847c142de85f tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:07.462724 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d9ef43da-9708-4d50-8365-847c142de85f tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:07.463182 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d9ef43da-9708-4d50-8365-847c142de85f tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:07.463590 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d9ef43da-9708-4d50-8365-847c142de85f tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:07.604881 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-d9ef43da-9708-4d50-8365-847c142de85f tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93774232c1479aa3e856bffb352140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b49ff217de14a2aae05d524128dec49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:07.613948 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-d9ef43da-9708-4d50-8365-847c142de85f tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] 10.222.0.59 "GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd" status: 200 len: 1504 microversion: 2.1 time: 0.167099 Aug 26 00:56:07.614556 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 165/339] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:07 2022] GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd => generated 1504 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:07.705973 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-e91abc46-3047-40dc-9a4e-dd7d800e1a5b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:07.706675 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-e91abc46-3047-40dc-9a4e-dd7d800e1a5b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:07.712978 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e91abc46-3047-40dc-9a4e-dd7d800e1a5b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:07.713466 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e91abc46-3047-40dc-9a4e-dd7d800e1a5b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:07.714090 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e91abc46-3047-40dc-9a4e-dd7d800e1a5b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:07.714788 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e91abc46-3047-40dc-9a4e-dd7d800e1a5b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:07.715244 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e91abc46-3047-40dc-9a4e-dd7d800e1a5b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:07.715668 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e91abc46-3047-40dc-9a4e-dd7d800e1a5b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:07.852211 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-e91abc46-3047-40dc-9a4e-dd7d800e1a5b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:07.861797 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-e91abc46-3047-40dc-9a4e-dd7d800e1a5b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab" status: 200 len: 1522 microversion: 2.1 time: 0.159513 Aug 26 00:56:07.862460 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 175/340] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:07 2022] GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:07.980998 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-88c32a60-3bff-4ef2-b37c-ae22b5572047 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:07.981610 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-88c32a60-3bff-4ef2-b37c-ae22b5572047 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:07.988006 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-88c32a60-3bff-4ef2-b37c-ae22b5572047 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:07.988396 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-88c32a60-3bff-4ef2-b37c-ae22b5572047 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:07.988866 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-88c32a60-3bff-4ef2-b37c-ae22b5572047 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:07.989550 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-88c32a60-3bff-4ef2-b37c-ae22b5572047 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:07.990004 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-88c32a60-3bff-4ef2-b37c-ae22b5572047 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:07.990432 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-88c32a60-3bff-4ef2-b37c-ae22b5572047 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:08.131113 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-88c32a60-3bff-4ef2-b37c-ae22b5572047 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:08.139559 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-88c32a60-3bff-4ef2-b37c-ae22b5572047 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:08.140982 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-88c32a60-3bff-4ef2-b37c-ae22b5572047 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:08.142191 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-88c32a60-3bff-4ef2-b37c-ae22b5572047 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1723 microversion: 2.20 time: 0.165010 Aug 26 00:56:08.143287 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 166/341] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:56:07 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:56:08.634798 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-54860aca-9101-4fd5-9b85-773bcd1b67a4 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:08.635646 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-54860aca-9101-4fd5-9b85-773bcd1b67a4 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: c56d5f8c-767e-4fa6-b714-d018853c73bd] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:08.637749 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:56:08.643051 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-54860aca-9101-4fd5-9b85-773bcd1b67a4 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:08.643542 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-54860aca-9101-4fd5-9b85-773bcd1b67a4 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:08.643986 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-54860aca-9101-4fd5-9b85-773bcd1b67a4 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:08.644709 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-54860aca-9101-4fd5-9b85-773bcd1b67a4 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:08.645167 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-54860aca-9101-4fd5-9b85-773bcd1b67a4 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:08.645591 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-54860aca-9101-4fd5-9b85-773bcd1b67a4 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:08.787312 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-54860aca-9101-4fd5-9b85-773bcd1b67a4 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93774232c1479aa3e856bffb352140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b49ff217de14a2aae05d524128dec49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:08.796070 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-54860aca-9101-4fd5-9b85-773bcd1b67a4 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] 10.222.0.59 "GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd" status: 200 len: 1504 microversion: 2.1 time: 0.165111 Aug 26 00:56:08.796652 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 176/342] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:08 2022] GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd => generated 1504 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:08.883667 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-c8249ab4-2576-46a6-9311-189c1dc52fcd tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:08.884275 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-c8249ab4-2576-46a6-9311-189c1dc52fcd tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:08.890252 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c8249ab4-2576-46a6-9311-189c1dc52fcd tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:08.890762 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c8249ab4-2576-46a6-9311-189c1dc52fcd tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:08.891187 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c8249ab4-2576-46a6-9311-189c1dc52fcd tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:08.892010 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c8249ab4-2576-46a6-9311-189c1dc52fcd tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:08.893015 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c8249ab4-2576-46a6-9311-189c1dc52fcd tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:08.893438 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c8249ab4-2576-46a6-9311-189c1dc52fcd tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:09.031841 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-c8249ab4-2576-46a6-9311-189c1dc52fcd tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:09.040718 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-c8249ab4-2576-46a6-9311-189c1dc52fcd tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab" status: 200 len: 1522 microversion: 2.1 time: 0.161260 Aug 26 00:56:09.041210 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 167/343] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:08 2022] GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:09.165888 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-af82ed1d-c788-4d55-871d-11bf040985fb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:09.166494 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-af82ed1d-c788-4d55-871d-11bf040985fb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:09.172313 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-af82ed1d-c788-4d55-871d-11bf040985fb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:09.172831 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-af82ed1d-c788-4d55-871d-11bf040985fb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:09.173257 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-af82ed1d-c788-4d55-871d-11bf040985fb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:09.174547 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-af82ed1d-c788-4d55-871d-11bf040985fb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:09.174998 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-af82ed1d-c788-4d55-871d-11bf040985fb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:09.175419 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-af82ed1d-c788-4d55-871d-11bf040985fb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:09.310811 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-af82ed1d-c788-4d55-871d-11bf040985fb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:09.319025 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-af82ed1d-c788-4d55-871d-11bf040985fb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:09.320499 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-af82ed1d-c788-4d55-871d-11bf040985fb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:09.321663 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-af82ed1d-c788-4d55-871d-11bf040985fb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1723 microversion: 2.20 time: 0.160021 Aug 26 00:56:09.322210 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 177/344] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:56:09 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:56:09.817233 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-b5789390-a76a-4560-9e40-068bc86dcbbe tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:09.817844 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-b5789390-a76a-4560-9e40-068bc86dcbbe tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: c56d5f8c-767e-4fa6-b714-d018853c73bd] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:09.823959 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b5789390-a76a-4560-9e40-068bc86dcbbe tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:09.824357 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b5789390-a76a-4560-9e40-068bc86dcbbe tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:09.824821 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b5789390-a76a-4560-9e40-068bc86dcbbe tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:09.825507 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b5789390-a76a-4560-9e40-068bc86dcbbe tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:09.825955 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b5789390-a76a-4560-9e40-068bc86dcbbe tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:09.826376 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b5789390-a76a-4560-9e40-068bc86dcbbe tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:09.957631 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-b5789390-a76a-4560-9e40-068bc86dcbbe tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93774232c1479aa3e856bffb352140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b49ff217de14a2aae05d524128dec49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:09.965763 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-b5789390-a76a-4560-9e40-068bc86dcbbe tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] 10.222.0.59 "GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd" status: 200 len: 1504 microversion: 2.1 time: 0.152902 Aug 26 00:56:09.966314 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 168/345] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:09 2022] GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:10.062162 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-fd09a9da-4586-45d5-b9b5-533eecd3d8dc tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:10.062776 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-fd09a9da-4586-45d5-b9b5-533eecd3d8dc tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:10.069316 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fd09a9da-4586-45d5-b9b5-533eecd3d8dc tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:10.069791 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fd09a9da-4586-45d5-b9b5-533eecd3d8dc tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:10.070275 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fd09a9da-4586-45d5-b9b5-533eecd3d8dc tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:10.070956 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fd09a9da-4586-45d5-b9b5-533eecd3d8dc tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:10.071430 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fd09a9da-4586-45d5-b9b5-533eecd3d8dc tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:10.071855 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fd09a9da-4586-45d5-b9b5-533eecd3d8dc tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:10.206346 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-fd09a9da-4586-45d5-b9b5-533eecd3d8dc tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:10.214486 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-fd09a9da-4586-45d5-b9b5-533eecd3d8dc tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab" status: 200 len: 1522 microversion: 2.1 time: 0.156215 Aug 26 00:56:10.215078 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 178/346] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:10 2022] GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:10.347099 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-3a96f7bb-560c-48cc-9639-bb38c3807511 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:10.349684 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-3a96f7bb-560c-48cc-9639-bb38c3807511 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:10.362250 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3a96f7bb-560c-48cc-9639-bb38c3807511 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:10.363112 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3a96f7bb-560c-48cc-9639-bb38c3807511 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:10.363893 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3a96f7bb-560c-48cc-9639-bb38c3807511 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:10.365393 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3a96f7bb-560c-48cc-9639-bb38c3807511 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:10.366223 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3a96f7bb-560c-48cc-9639-bb38c3807511 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:10.366999 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3a96f7bb-560c-48cc-9639-bb38c3807511 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:10.511562 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-3a96f7bb-560c-48cc-9639-bb38c3807511 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:10.519856 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-3a96f7bb-560c-48cc-9639-bb38c3807511 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:10.521369 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-3a96f7bb-560c-48cc-9639-bb38c3807511 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:10.522543 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-3a96f7bb-560c-48cc-9639-bb38c3807511 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1723 microversion: 2.20 time: 0.181930 Aug 26 00:56:10.523902 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 169/347] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:56:10 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:56:10.985859 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-e3b83063-61e6-4645-aa39-1bfc4f551a5f tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:10.986287 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-e3b83063-61e6-4645-aa39-1bfc4f551a5f tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: c56d5f8c-767e-4fa6-b714-d018853c73bd] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:10.992561 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e3b83063-61e6-4645-aa39-1bfc4f551a5f tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:10.993046 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e3b83063-61e6-4645-aa39-1bfc4f551a5f tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:10.993474 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e3b83063-61e6-4645-aa39-1bfc4f551a5f tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:10.994165 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e3b83063-61e6-4645-aa39-1bfc4f551a5f tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:10.994610 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e3b83063-61e6-4645-aa39-1bfc4f551a5f tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:10.995032 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e3b83063-61e6-4645-aa39-1bfc4f551a5f tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:11.129961 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-e3b83063-61e6-4645-aa39-1bfc4f551a5f tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93774232c1479aa3e856bffb352140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b49ff217de14a2aae05d524128dec49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:11.137722 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-e3b83063-61e6-4645-aa39-1bfc4f551a5f tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] 10.222.0.59 "GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd" status: 200 len: 1504 microversion: 2.1 time: 0.155892 Aug 26 00:56:11.138280 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 179/348] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:10 2022] GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:11.235579 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-4c50f605-1b08-4530-ac87-0b354320007e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:11.236246 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-4c50f605-1b08-4530-ac87-0b354320007e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:11.242269 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4c50f605-1b08-4530-ac87-0b354320007e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:11.242744 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4c50f605-1b08-4530-ac87-0b354320007e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:11.243174 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4c50f605-1b08-4530-ac87-0b354320007e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:11.243857 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4c50f605-1b08-4530-ac87-0b354320007e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:11.244302 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4c50f605-1b08-4530-ac87-0b354320007e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:11.244757 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4c50f605-1b08-4530-ac87-0b354320007e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:11.373344 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-4c50f605-1b08-4530-ac87-0b354320007e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:11.381848 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-4c50f605-1b08-4530-ac87-0b354320007e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab" status: 200 len: 1522 microversion: 2.1 time: 0.150249 Aug 26 00:56:11.382417 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 170/349] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:11 2022] GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:11.546278 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-8ce5c6d1-f78f-4f7e-b469-7bee359dc141 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:11.547006 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-8ce5c6d1-f78f-4f7e-b469-7bee359dc141 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:11.552941 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8ce5c6d1-f78f-4f7e-b469-7bee359dc141 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:11.553430 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8ce5c6d1-f78f-4f7e-b469-7bee359dc141 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:11.553885 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8ce5c6d1-f78f-4f7e-b469-7bee359dc141 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:11.554599 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8ce5c6d1-f78f-4f7e-b469-7bee359dc141 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:11.555047 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8ce5c6d1-f78f-4f7e-b469-7bee359dc141 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:11.555497 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8ce5c6d1-f78f-4f7e-b469-7bee359dc141 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:11.703396 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-8ce5c6d1-f78f-4f7e-b469-7bee359dc141 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:11.715182 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-8ce5c6d1-f78f-4f7e-b469-7bee359dc141 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:11.716737 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-8ce5c6d1-f78f-4f7e-b469-7bee359dc141 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:11.718342 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-8ce5c6d1-f78f-4f7e-b469-7bee359dc141 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1723 microversion: 2.20 time: 0.175875 Aug 26 00:56:11.719109 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 180/350] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:56:11 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:56:12.160920 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-6782bc3e-a7a7-47bd-8918-704c1bb5dffc tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:12.161563 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-6782bc3e-a7a7-47bd-8918-704c1bb5dffc tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: c56d5f8c-767e-4fa6-b714-d018853c73bd] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:12.167893 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6782bc3e-a7a7-47bd-8918-704c1bb5dffc tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:12.168374 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6782bc3e-a7a7-47bd-8918-704c1bb5dffc tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:12.168828 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6782bc3e-a7a7-47bd-8918-704c1bb5dffc tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:12.169508 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6782bc3e-a7a7-47bd-8918-704c1bb5dffc tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:12.169952 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6782bc3e-a7a7-47bd-8918-704c1bb5dffc tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:12.170368 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6782bc3e-a7a7-47bd-8918-704c1bb5dffc tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:12.313046 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-6782bc3e-a7a7-47bd-8918-704c1bb5dffc tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93774232c1479aa3e856bffb352140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b49ff217de14a2aae05d524128dec49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:12.327034 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-6782bc3e-a7a7-47bd-8918-704c1bb5dffc tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] 10.222.0.59 "GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd" status: 200 len: 1504 microversion: 2.1 time: 0.165662 Aug 26 00:56:12.327034 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 171/351] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:12 2022] GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd => generated 1504 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:12.404116 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-026b3cdd-a4bb-4c32-8add-f2fcee16d695 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:12.404762 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-026b3cdd-a4bb-4c32-8add-f2fcee16d695 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:12.412638 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-026b3cdd-a4bb-4c32-8add-f2fcee16d695 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:12.416678 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-026b3cdd-a4bb-4c32-8add-f2fcee16d695 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:12.416678 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-026b3cdd-a4bb-4c32-8add-f2fcee16d695 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:12.416678 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-026b3cdd-a4bb-4c32-8add-f2fcee16d695 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:12.416678 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-026b3cdd-a4bb-4c32-8add-f2fcee16d695 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:12.417116 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-026b3cdd-a4bb-4c32-8add-f2fcee16d695 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:12.550208 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-026b3cdd-a4bb-4c32-8add-f2fcee16d695 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:12.559313 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-026b3cdd-a4bb-4c32-8add-f2fcee16d695 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab" status: 200 len: 1522 microversion: 2.1 time: 0.159647 Aug 26 00:56:12.559876 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 181/352] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:12 2022] GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:12.745593 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-1304de13-5018-42f2-aa50-b6f405506228 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:12.746206 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-1304de13-5018-42f2-aa50-b6f405506228 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:12.753195 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1304de13-5018-42f2-aa50-b6f405506228 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:12.753679 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1304de13-5018-42f2-aa50-b6f405506228 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:12.754119 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1304de13-5018-42f2-aa50-b6f405506228 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:12.754818 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1304de13-5018-42f2-aa50-b6f405506228 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:12.755271 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1304de13-5018-42f2-aa50-b6f405506228 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:12.755700 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1304de13-5018-42f2-aa50-b6f405506228 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:12.760565 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell1:SELECT=100 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:56:12.899903 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-1304de13-5018-42f2-aa50-b6f405506228 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:12.908211 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-1304de13-5018-42f2-aa50-b6f405506228 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:12.909711 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-1304de13-5018-42f2-aa50-b6f405506228 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:12.912713 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-1304de13-5018-42f2-aa50-b6f405506228 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1723 microversion: 2.20 time: 0.169201 Aug 26 00:56:12.912713 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 172/353] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:56:12 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:56:13.341589 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-158d7a34-3a76-41c2-8061-204a05fb81a7 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:13.342197 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-158d7a34-3a76-41c2-8061-204a05fb81a7 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: c56d5f8c-767e-4fa6-b714-d018853c73bd] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:13.348101 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-158d7a34-3a76-41c2-8061-204a05fb81a7 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:13.348612 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-158d7a34-3a76-41c2-8061-204a05fb81a7 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:13.349051 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-158d7a34-3a76-41c2-8061-204a05fb81a7 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:13.349735 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-158d7a34-3a76-41c2-8061-204a05fb81a7 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:13.350183 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-158d7a34-3a76-41c2-8061-204a05fb81a7 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:13.350724 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-158d7a34-3a76-41c2-8061-204a05fb81a7 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:13.486778 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-158d7a34-3a76-41c2-8061-204a05fb81a7 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93774232c1479aa3e856bffb352140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b49ff217de14a2aae05d524128dec49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:13.495449 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-158d7a34-3a76-41c2-8061-204a05fb81a7 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] 10.222.0.59 "GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd" status: 200 len: 1504 microversion: 2.1 time: 0.157717 Aug 26 00:56:13.496010 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 182/354] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:13 2022] GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:13.580772 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-918d266b-9281-4265-aaae-1d2712a6d2e3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:13.581465 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-918d266b-9281-4265-aaae-1d2712a6d2e3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:13.597281 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-918d266b-9281-4265-aaae-1d2712a6d2e3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:13.597770 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-918d266b-9281-4265-aaae-1d2712a6d2e3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:13.598202 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-918d266b-9281-4265-aaae-1d2712a6d2e3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:13.598890 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-918d266b-9281-4265-aaae-1d2712a6d2e3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:13.599371 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-918d266b-9281-4265-aaae-1d2712a6d2e3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:13.599795 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-918d266b-9281-4265-aaae-1d2712a6d2e3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:13.732390 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-918d266b-9281-4265-aaae-1d2712a6d2e3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:13.740055 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-918d266b-9281-4265-aaae-1d2712a6d2e3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab" status: 200 len: 1522 microversion: 2.1 time: 0.163075 Aug 26 00:56:13.740621 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 173/355] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:13 2022] GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:56:13.933550 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-de3f9cdf-e467-4c66-91a4-563d4e6308c4 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:13.934222 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-de3f9cdf-e467-4c66-91a4-563d4e6308c4 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:13.940796 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-de3f9cdf-e467-4c66-91a4-563d4e6308c4 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:13.941280 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-de3f9cdf-e467-4c66-91a4-563d4e6308c4 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:13.941762 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-de3f9cdf-e467-4c66-91a4-563d4e6308c4 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:13.942461 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-de3f9cdf-e467-4c66-91a4-563d4e6308c4 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:13.942916 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-de3f9cdf-e467-4c66-91a4-563d4e6308c4 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:13.943334 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-de3f9cdf-e467-4c66-91a4-563d4e6308c4 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:14.083274 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-de3f9cdf-e467-4c66-91a4-563d4e6308c4 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:14.083274 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:56:14.084963 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-de3f9cdf-e467-4c66-91a4-563d4e6308c4 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:14.086513 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-de3f9cdf-e467-4c66-91a4-563d4e6308c4 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:14.087718 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-de3f9cdf-e467-4c66-91a4-563d4e6308c4 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1723 microversion: 2.20 time: 0.158069 Aug 26 00:56:14.088261 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 183/356] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:56:13 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:56:14.517001 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-feb7c0b9-1281-4eb2-abb0-eff630eaa3f2 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:14.518372 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-feb7c0b9-1281-4eb2-abb0-eff630eaa3f2 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: c56d5f8c-767e-4fa6-b714-d018853c73bd] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:14.525115 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-feb7c0b9-1281-4eb2-abb0-eff630eaa3f2 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:14.525678 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-feb7c0b9-1281-4eb2-abb0-eff630eaa3f2 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:14.526154 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-feb7c0b9-1281-4eb2-abb0-eff630eaa3f2 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:14.526918 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-feb7c0b9-1281-4eb2-abb0-eff630eaa3f2 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:14.527366 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-feb7c0b9-1281-4eb2-abb0-eff630eaa3f2 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:14.527808 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-feb7c0b9-1281-4eb2-abb0-eff630eaa3f2 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:14.661371 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-feb7c0b9-1281-4eb2-abb0-eff630eaa3f2 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93774232c1479aa3e856bffb352140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b49ff217de14a2aae05d524128dec49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:14.669368 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-feb7c0b9-1281-4eb2-abb0-eff630eaa3f2 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] 10.222.0.59 "GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd" status: 200 len: 1504 microversion: 2.1 time: 0.156610 Aug 26 00:56:14.669924 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 174/357] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:14 2022] GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:14.762852 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-bba3f0ef-21bb-4677-bce1-afbb6527c17f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:14.763615 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-bba3f0ef-21bb-4677-bce1-afbb6527c17f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:14.771469 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bba3f0ef-21bb-4677-bce1-afbb6527c17f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:14.771948 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bba3f0ef-21bb-4677-bce1-afbb6527c17f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:14.772388 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bba3f0ef-21bb-4677-bce1-afbb6527c17f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:14.773119 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bba3f0ef-21bb-4677-bce1-afbb6527c17f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:14.773582 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bba3f0ef-21bb-4677-bce1-afbb6527c17f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:14.774009 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bba3f0ef-21bb-4677-bce1-afbb6527c17f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:14.904208 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-bba3f0ef-21bb-4677-bce1-afbb6527c17f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:14.912576 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-bba3f0ef-21bb-4677-bce1-afbb6527c17f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab" status: 200 len: 1522 microversion: 2.1 time: 0.153965 Aug 26 00:56:14.913151 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 184/358] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:14 2022] GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:15.111968 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-39179dd9-55f7-4b28-a178-f00765f0ff12 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:15.112642 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-39179dd9-55f7-4b28-a178-f00765f0ff12 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:15.119352 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-39179dd9-55f7-4b28-a178-f00765f0ff12 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:15.119942 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-39179dd9-55f7-4b28-a178-f00765f0ff12 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:15.120379 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-39179dd9-55f7-4b28-a178-f00765f0ff12 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:15.121108 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-39179dd9-55f7-4b28-a178-f00765f0ff12 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:15.121559 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-39179dd9-55f7-4b28-a178-f00765f0ff12 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:15.121985 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-39179dd9-55f7-4b28-a178-f00765f0ff12 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:15.264612 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-39179dd9-55f7-4b28-a178-f00765f0ff12 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:15.276891 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-39179dd9-55f7-4b28-a178-f00765f0ff12 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:15.276891 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-39179dd9-55f7-4b28-a178-f00765f0ff12 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:15.276891 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-39179dd9-55f7-4b28-a178-f00765f0ff12 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1723 microversion: 2.20 time: 0.168109 Aug 26 00:56:15.277237 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 175/359] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:56:15 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:56:15.695307 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-32818fbc-6a75-4bc7-bee7-f578f3332ba5 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:15.695845 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-32818fbc-6a75-4bc7-bee7-f578f3332ba5 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: c56d5f8c-767e-4fa6-b714-d018853c73bd] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:15.702450 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-32818fbc-6a75-4bc7-bee7-f578f3332ba5 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:15.702921 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-32818fbc-6a75-4bc7-bee7-f578f3332ba5 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:15.703348 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-32818fbc-6a75-4bc7-bee7-f578f3332ba5 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:15.704027 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-32818fbc-6a75-4bc7-bee7-f578f3332ba5 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:15.704487 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-32818fbc-6a75-4bc7-bee7-f578f3332ba5 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:15.705002 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-32818fbc-6a75-4bc7-bee7-f578f3332ba5 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:15.857505 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-32818fbc-6a75-4bc7-bee7-f578f3332ba5 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93774232c1479aa3e856bffb352140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b49ff217de14a2aae05d524128dec49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:15.865232 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-32818fbc-6a75-4bc7-bee7-f578f3332ba5 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] 10.222.0.59 "GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd" status: 200 len: 1504 microversion: 2.1 time: 0.173831 Aug 26 00:56:15.865847 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 185/360] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:15 2022] GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd => generated 1504 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:15.933124 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-e6211a7c-7027-42f2-b100-284bdc02437f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:15.933732 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-e6211a7c-7027-42f2-b100-284bdc02437f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:15.940326 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e6211a7c-7027-42f2-b100-284bdc02437f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:15.940839 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e6211a7c-7027-42f2-b100-284bdc02437f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:15.941475 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e6211a7c-7027-42f2-b100-284bdc02437f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:15.942226 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e6211a7c-7027-42f2-b100-284bdc02437f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:15.942842 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e6211a7c-7027-42f2-b100-284bdc02437f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:15.943425 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e6211a7c-7027-42f2-b100-284bdc02437f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:16.106543 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-e6211a7c-7027-42f2-b100-284bdc02437f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:16.114745 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-e6211a7c-7027-42f2-b100-284bdc02437f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab" status: 200 len: 1522 microversion: 2.1 time: 0.185498 Aug 26 00:56:16.115301 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 176/361] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:15 2022] GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:16.299839 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-a2fdd125-3dc2-4d9d-94df-20a4f42af175 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:16.300555 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-a2fdd125-3dc2-4d9d-94df-20a4f42af175 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:16.306771 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a2fdd125-3dc2-4d9d-94df-20a4f42af175 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:16.307257 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a2fdd125-3dc2-4d9d-94df-20a4f42af175 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:16.307740 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a2fdd125-3dc2-4d9d-94df-20a4f42af175 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:16.308410 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a2fdd125-3dc2-4d9d-94df-20a4f42af175 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:16.308850 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a2fdd125-3dc2-4d9d-94df-20a4f42af175 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:16.309270 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a2fdd125-3dc2-4d9d-94df-20a4f42af175 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:16.445921 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-a2fdd125-3dc2-4d9d-94df-20a4f42af175 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:16.455834 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-a2fdd125-3dc2-4d9d-94df-20a4f42af175 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:16.455834 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-a2fdd125-3dc2-4d9d-94df-20a4f42af175 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:16.457180 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-a2fdd125-3dc2-4d9d-94df-20a4f42af175 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1723 microversion: 2.20 time: 0.162526 Aug 26 00:56:16.457918 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 186/362] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:56:16 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:56:16.886935 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-db15130e-deb9-4920-8a8c-e79559d12b2d tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:16.887543 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-db15130e-deb9-4920-8a8c-e79559d12b2d tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: c56d5f8c-767e-4fa6-b714-d018853c73bd] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:16.894124 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-db15130e-deb9-4920-8a8c-e79559d12b2d tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:16.894655 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-db15130e-deb9-4920-8a8c-e79559d12b2d tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:16.895044 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-db15130e-deb9-4920-8a8c-e79559d12b2d tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:16.895924 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-db15130e-deb9-4920-8a8c-e79559d12b2d tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:16.896376 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-db15130e-deb9-4920-8a8c-e79559d12b2d tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:16.896827 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-db15130e-deb9-4920-8a8c-e79559d12b2d tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:17.040251 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-db15130e-deb9-4920-8a8c-e79559d12b2d tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93774232c1479aa3e856bffb352140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b49ff217de14a2aae05d524128dec49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:17.044862 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-db15130e-deb9-4920-8a8c-e79559d12b2d tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] 10.222.0.59 "GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd" status: 200 len: 1504 microversion: 2.1 time: 0.161852 Aug 26 00:56:17.045461 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 177/363] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:16 2022] GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:17.135324 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-bc2921d9-6bce-47e3-9036-78a9b83551eb tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:17.135979 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-bc2921d9-6bce-47e3-9036-78a9b83551eb tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:17.143160 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bc2921d9-6bce-47e3-9036-78a9b83551eb tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:17.143710 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bc2921d9-6bce-47e3-9036-78a9b83551eb tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:17.144131 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bc2921d9-6bce-47e3-9036-78a9b83551eb tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:17.144862 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bc2921d9-6bce-47e3-9036-78a9b83551eb tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:17.145306 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bc2921d9-6bce-47e3-9036-78a9b83551eb tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:17.145763 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bc2921d9-6bce-47e3-9036-78a9b83551eb tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:17.277244 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-bc2921d9-6bce-47e3-9036-78a9b83551eb tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:17.285048 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-bc2921d9-6bce-47e3-9036-78a9b83551eb tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab" status: 200 len: 1502 microversion: 2.1 time: 0.153694 Aug 26 00:56:17.285552 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 187/364] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:17 2022] GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab => generated 1502 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:17.305599 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-51db1f4f-4a1f-4b23-a70a-ffd691d5e737 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8e94c0e7-523f-4a26-af94-6751e4b529cd"}} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:56:17.308049 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-51db1f4f-4a1f-4b23-a70a-ffd691d5e737 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:17.314851 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-51db1f4f-4a1f-4b23-a70a-ffd691d5e737 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:17.317441 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-51db1f4f-4a1f-4b23-a70a-ffd691d5e737 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:17.317441 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-51db1f4f-4a1f-4b23-a70a-ffd691d5e737 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:17.317441 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-51db1f4f-4a1f-4b23-a70a-ffd691d5e737 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:17.317441 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-51db1f4f-4a1f-4b23-a70a-ffd691d5e737 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:17.317876 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-51db1f4f-4a1f-4b23-a70a-ffd691d5e737 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:17.342728 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.wsgi [None req-51db1f4f-4a1f-4b23-a70a-ffd691d5e737 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] HTTP exception thrown: Cannot 'attach_volume' instance 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab while it is in vm_state rescued Aug 26 00:56:17.344438 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-51db1f4f-4a1f-4b23-a70a-ffd691d5e737 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Request method failure captured: Aug 26 00:56:17.344438 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: request: POST /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab/os-volume_attachments HTTP/1.1 Aug 26 00:56:17.344438 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Accept: application/json Aug 26 00:56:17.344438 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Accept-Encoding: identity Aug 26 00:56:17.344438 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Connection: close Aug 26 00:56:17.344438 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Content-Length: 74 Aug 26 00:56:17.344438 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Content-Type: application/json Aug 26 00:56:17.344438 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Host: 10.222.0.59 Aug 26 00:56:17.344438 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Openstack-System-Scope: None Aug 26 00:56:17.344438 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: User-Agent: python-urllib3/1.26.11 Aug 26 00:56:17.344438 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Auth-Token: gAAAAABjCBmefHFNNUqFlMUE7I3i-93USVXZAM-jGRx67LwRrBQPHws8Ly74cPkf0mck5rrbALQjBE8Uy7qr03rwitlw4-vjXBtSJZuAAkljOdu1vNSZ4iHfo9uVWiTpSJogUteHYoVEbCAE9IBTiJYBlMj1AATIr86-7txLA_xIrQ0LluUT1u0 Aug 26 00:56:17.344438 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Domain-Id: None Aug 26 00:56:17.344438 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Domain-Name: None Aug 26 00:56:17.344438 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Identity-Status: Confirmed Aug 26 00:56:17.344438 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Is-Admin-Project: True Aug 26 00:56:17.344438 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Domain-Id: default Aug 26 00:56:17.344438 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Domain-Name: Default Aug 26 00:56:17.344438 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Id: 368f6a9e030e4aff9ef6559a6a165975 Aug 26 00:56:17.344438 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-988292211 Aug 26 00:56:17.344438 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Role: reader,member Aug 26 00:56:17.344438 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Roles: reader,member Aug 26 00:56:17.353293 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_368f6a9e030e4aff9ef6559a6a165975"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/368f6a9e030e4aff9ef6559a6a165975"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/368f6a9e030e4aff9ef6559a6a165975"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/368f6a9e030e4aff9ef6559a6a165975"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 00:56:17.353293 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant: tempest-ServerRescueNegativeTestJSON-988292211 Aug 26 00:56:17.353293 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant-Id: 368f6a9e030e4aff9ef6559a6a165975 Aug 26 00:56:17.353293 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-988292211 Aug 26 00:56:17.353293 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User: tempest-ServerRescueNegativeTestJSON-988292211-project Aug 26 00:56:17.353293 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Domain-Id: default Aug 26 00:56:17.353293 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Domain-Name: Default Aug 26 00:56:17.353293 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Id: 0cc36def73aa4bedb9e79d4cf11f5e8c Aug 26 00:56:17.353293 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Name: tempest-ServerRescueNegativeTestJSON-988292211-project Aug 26 00:56:17.353293 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Aug 26 00:56:17.353293 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: {"volumeAttachment": {"volumeId": "8e94c0e7-523f-4a26-af94-6751e4b529cd"}} Aug 26 00:56:17.353293 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: method: > Aug 26 00:56:17.354173 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: exception: Cannot 'attach_volume' instance 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab while it is in vm_state rescued Aug 26 00:56:17.354173 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: action_args: {'server_id': '3079fdb4-9b6d-4030-a7ce-bdf5bff324ab', 'body': {'volumeAttachment': {'volumeId': '8e94c0e7-523f-4a26-af94-6751e4b529cd'}}} Aug 26 00:56:17.354173 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 00:56:17.354173 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:56:17.354173 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 26 00:56:17.354173 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 26 00:56:17.354173 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 26 00:56:17.354173 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 26 00:56:17.354173 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 26 00:56:17.354173 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 26 00:56:17.354173 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 26 00:56:17.354173 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:56:17.354173 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 00:56:17.354173 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:56:17.354173 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:56:17.354173 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 00:56:17.354173 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 00:56:17.354173 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 00:56:17.354173 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 00:56:17.355438 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 00:56:17.355438 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 00:56:17.355438 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 00:56:17.355438 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 00:56:17.355438 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 00:56:17.355438 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 00:56:17.355438 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 00:56:17.355438 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 00:56:17.355438 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 26 00:56:17.355438 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 26 00:56:17.355438 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 26 00:56:17.355438 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 26 00:56:17.355438 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab while it is in vm_state rescued Aug 26 00:56:17.355438 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:56:17.355438 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 00:56:17.355438 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:56:17.355438 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:56:17.355438 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 00:56:17.355438 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 00:56:17.356654 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 00:56:17.356654 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 00:56:17.356654 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab while it is in vm_state rescued Aug 26 00:56:17.356654 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:56:17.356654 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-51db1f4f-4a1f-4b23-a70a-ffd691d5e737 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Returning 409 to user: Cannot 'attach_volume' instance 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab while it is in vm_state rescued {{(pid=127565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 00:56:17.356654 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-51db1f4f-4a1f-4b23-a70a-ffd691d5e737 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "POST /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.044315 Aug 26 00:56:17.356654 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 178/365] 10.222.0.59 () {60 vars in 1323 bytes} [Fri Aug 26 00:56:17 2022] POST /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab/os-volume_attachments => generated 152 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 26 00:56:17.359722 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-077c0a73-5a89-4f85-8cd4-23b4118fd600 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:56:17.360267 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-077c0a73-5a89-4f85-8cd4-23b4118fd600 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:17.366775 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-077c0a73-5a89-4f85-8cd4-23b4118fd600 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:17.367418 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-077c0a73-5a89-4f85-8cd4-23b4118fd600 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:17.367738 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-077c0a73-5a89-4f85-8cd4-23b4118fd600 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:17.368443 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-077c0a73-5a89-4f85-8cd4-23b4118fd600 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:17.368936 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-077c0a73-5a89-4f85-8cd4-23b4118fd600 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:17.369888 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-077c0a73-5a89-4f85-8cd4-23b4118fd600 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:17.481085 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-a0cf4155-c98b-4bc7-8829-eb0c71ea8614 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:17.481695 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-a0cf4155-c98b-4bc7-8829-eb0c71ea8614 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:17.487711 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a0cf4155-c98b-4bc7-8829-eb0c71ea8614 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:17.488215 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a0cf4155-c98b-4bc7-8829-eb0c71ea8614 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:17.488667 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a0cf4155-c98b-4bc7-8829-eb0c71ea8614 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:17.489622 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a0cf4155-c98b-4bc7-8829-eb0c71ea8614 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:17.489857 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a0cf4155-c98b-4bc7-8829-eb0c71ea8614 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:17.490412 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a0cf4155-c98b-4bc7-8829-eb0c71ea8614 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:17.568747 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-077c0a73-5a89-4f85-8cd4-23b4118fd600 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "POST /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab/action" status: 202 len: 0 microversion: 2.1 time: 0.212810 Aug 26 00:56:17.569394 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 188/366] 10.222.0.59 () {60 vars in 1278 bytes} [Fri Aug 26 00:56:17 2022] POST /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 00:56:17.578644 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-497ce1c4-b541-4290-a78c-515de9af6b86 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:17.579533 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-497ce1c4-b541-4290-a78c-515de9af6b86 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:17.586748 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-497ce1c4-b541-4290-a78c-515de9af6b86 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:17.589706 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-497ce1c4-b541-4290-a78c-515de9af6b86 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:17.589706 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-497ce1c4-b541-4290-a78c-515de9af6b86 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:17.589706 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-497ce1c4-b541-4290-a78c-515de9af6b86 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:17.589706 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-497ce1c4-b541-4290-a78c-515de9af6b86 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:17.590096 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-497ce1c4-b541-4290-a78c-515de9af6b86 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:17.637133 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-a0cf4155-c98b-4bc7-8829-eb0c71ea8614 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:17.645718 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-a0cf4155-c98b-4bc7-8829-eb0c71ea8614 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:17.647464 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-a0cf4155-c98b-4bc7-8829-eb0c71ea8614 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:17.648867 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-a0cf4155-c98b-4bc7-8829-eb0c71ea8614 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1744 microversion: 2.20 time: 0.171752 Aug 26 00:56:17.649412 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 179/367] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:56:17 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1744 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 00:56:17.738847 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-497ce1c4-b541-4290-a78c-515de9af6b86 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:17.746527 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-497ce1c4-b541-4290-a78c-515de9af6b86 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab" status: 200 len: 1510 microversion: 2.1 time: 0.172747 Aug 26 00:56:17.747087 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 189/368] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:17 2022] GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab => generated 1510 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:56:18.067514 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-058f1868-4cf6-48f3-bcf6-51c7b00cf402 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:18.068745 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-058f1868-4cf6-48f3-bcf6-51c7b00cf402 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: c56d5f8c-767e-4fa6-b714-d018853c73bd] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:18.075093 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-058f1868-4cf6-48f3-bcf6-51c7b00cf402 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:18.075575 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-058f1868-4cf6-48f3-bcf6-51c7b00cf402 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:18.076041 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-058f1868-4cf6-48f3-bcf6-51c7b00cf402 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:18.076772 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-058f1868-4cf6-48f3-bcf6-51c7b00cf402 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:18.077226 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-058f1868-4cf6-48f3-bcf6-51c7b00cf402 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:18.077648 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-058f1868-4cf6-48f3-bcf6-51c7b00cf402 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:18.214666 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-058f1868-4cf6-48f3-bcf6-51c7b00cf402 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93774232c1479aa3e856bffb352140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b49ff217de14a2aae05d524128dec49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:18.222538 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-058f1868-4cf6-48f3-bcf6-51c7b00cf402 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] 10.222.0.59 "GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd" status: 200 len: 1504 microversion: 2.1 time: 0.160797 Aug 26 00:56:18.223103 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 180/369] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:18 2022] GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:18.672159 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-fd4a8d69-8c94-46f3-b2a5-93e240a64e29 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:18.672796 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-fd4a8d69-8c94-46f3-b2a5-93e240a64e29 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:18.679218 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fd4a8d69-8c94-46f3-b2a5-93e240a64e29 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:18.679693 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fd4a8d69-8c94-46f3-b2a5-93e240a64e29 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:18.680147 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fd4a8d69-8c94-46f3-b2a5-93e240a64e29 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:18.681021 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fd4a8d69-8c94-46f3-b2a5-93e240a64e29 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:18.681380 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fd4a8d69-8c94-46f3-b2a5-93e240a64e29 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:18.682532 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fd4a8d69-8c94-46f3-b2a5-93e240a64e29 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:18.767642 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-9438910a-6417-4374-a933-ca1a0eb9efb5 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:18.768254 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-9438910a-6417-4374-a933-ca1a0eb9efb5 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:18.783360 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9438910a-6417-4374-a933-ca1a0eb9efb5 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:18.783850 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9438910a-6417-4374-a933-ca1a0eb9efb5 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:18.784283 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9438910a-6417-4374-a933-ca1a0eb9efb5 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:18.785006 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9438910a-6417-4374-a933-ca1a0eb9efb5 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:18.785454 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9438910a-6417-4374-a933-ca1a0eb9efb5 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:18.785871 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9438910a-6417-4374-a933-ca1a0eb9efb5 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:18.999966 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-fd4a8d69-8c94-46f3-b2a5-93e240a64e29 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:19.014491 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-fd4a8d69-8c94-46f3-b2a5-93e240a64e29 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:19.016844 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-fd4a8d69-8c94-46f3-b2a5-93e240a64e29 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:19.018845 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-fd4a8d69-8c94-46f3-b2a5-93e240a64e29 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1744 microversion: 2.20 time: 0.350545 Aug 26 00:56:19.019900 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 190/370] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:56:18 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1744 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:56:19.104328 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-9438910a-6417-4374-a933-ca1a0eb9efb5 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:19.113355 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-9438910a-6417-4374-a933-ca1a0eb9efb5 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab" status: 200 len: 1510 microversion: 2.1 time: 0.349560 Aug 26 00:56:19.117677 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 181/371] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:18 2022] GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab => generated 1510 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:19.243471 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-2eeb7c6f-dedc-4b91-95e4-e9f58e3b9ddd tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:19.244588 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-2eeb7c6f-dedc-4b91-95e4-e9f58e3b9ddd tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: c56d5f8c-767e-4fa6-b714-d018853c73bd] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:19.256528 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2eeb7c6f-dedc-4b91-95e4-e9f58e3b9ddd tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:19.257829 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2eeb7c6f-dedc-4b91-95e4-e9f58e3b9ddd tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:19.259335 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2eeb7c6f-dedc-4b91-95e4-e9f58e3b9ddd tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:19.260627 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2eeb7c6f-dedc-4b91-95e4-e9f58e3b9ddd tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:19.265144 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2eeb7c6f-dedc-4b91-95e4-e9f58e3b9ddd tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:19.265586 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2eeb7c6f-dedc-4b91-95e4-e9f58e3b9ddd tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:19.379784 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-2d4317d5-f6ad-4775-be34-cb85fc5bd29d tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:56:19.392299 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2d4317d5-f6ad-4775-be34-cb85fc5bd29d tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:19.394028 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-2eeb7c6f-dedc-4b91-95e4-e9f58e3b9ddd tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93774232c1479aa3e856bffb352140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b49ff217de14a2aae05d524128dec49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:19.396464 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2d4317d5-f6ad-4775-be34-cb85fc5bd29d tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:19.396812 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2d4317d5-f6ad-4775-be34-cb85fc5bd29d tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:19.415130 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-2eeb7c6f-dedc-4b91-95e4-e9f58e3b9ddd tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] 10.222.0.59 "GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd" status: 200 len: 1462 microversion: 2.1 time: 0.175715 Aug 26 00:56:19.418672 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 191/372] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:19 2022] GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd => generated 1462 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:19.477042 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-2d4317d5-f6ad-4775-be34-cb85fc5bd29d tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Going to try to stop instance {{(pid=127565) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 26 00:56:19.478251 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [req-c93f193d-4607-4a7e-b66d-14c6c6f9149c req-738ef8fa-3647-4c57-a6ef-0a1fd8850132 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c56d5f8c-767e-4fa6-b714-d018853c73bd", "name": "network-vif-deleted", "tag": "03c66732-36bf-4fb0-a82e-c2791f578710"}]} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:56:19.494100 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-c93f193d-4607-4a7e-b66d-14c6c6f9149c req-738ef8fa-3647-4c57-a6ef-0a1fd8850132 service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:19.494639 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-c93f193d-4607-4a7e-b66d-14c6c6f9149c req-738ef8fa-3647-4c57-a6ef-0a1fd8850132 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:19.495076 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-c93f193d-4607-4a7e-b66d-14c6c6f9149c req-738ef8fa-3647-4c57-a6ef-0a1fd8850132 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:19.509966 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.compute.server_external_events [req-c93f193d-4607-4a7e-b66d-14c6c6f9149c req-738ef8fa-3647-4c57-a6ef-0a1fd8850132 service nova] Creating event network-vif-deleted:03c66732-36bf-4fb0-a82e-c2791f578710 for instance c56d5f8c-767e-4fa6-b714-d018853c73bd on hv-cinder-83538 Aug 26 00:56:19.515319 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [req-c93f193d-4607-4a7e-b66d-14c6c6f9149c req-738ef8fa-3647-4c57-a6ef-0a1fd8850132 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046674 Aug 26 00:56:19.518025 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 192/373] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 00:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:56:19.656458 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-2d4317d5-f6ad-4775-be34-cb85fc5bd29d tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "POST /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7/action" status: 202 len: 0 microversion: 2.1 time: 0.280856 Aug 26 00:56:19.657446 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 182/374] 10.222.0.59 () {60 vars in 1278 bytes} [Fri Aug 26 00:56:19 2022] POST /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 26 00:56:19.669561 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-50741d40-5b14-48b6-8dd7-f0b89df42452 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:19.670494 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-50741d40-5b14-48b6-8dd7-f0b89df42452 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:19.678994 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-50741d40-5b14-48b6-8dd7-f0b89df42452 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:19.679660 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-50741d40-5b14-48b6-8dd7-f0b89df42452 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:19.680039 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-50741d40-5b14-48b6-8dd7-f0b89df42452 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:19.680780 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-50741d40-5b14-48b6-8dd7-f0b89df42452 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:19.681289 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-50741d40-5b14-48b6-8dd7-f0b89df42452 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:19.681659 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-50741d40-5b14-48b6-8dd7-f0b89df42452 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:19.827768 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-50741d40-5b14-48b6-8dd7-f0b89df42452 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:19.836043 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-50741d40-5b14-48b6-8dd7-f0b89df42452 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1721 microversion: 2.1 time: 0.174048 Aug 26 00:56:19.836639 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 193/375] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:19 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:20.042410 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-d03197c2-3be9-47db-a87b-d32efedc4f78 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:20.043093 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-d03197c2-3be9-47db-a87b-d32efedc4f78 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:20.045065 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_api:SELECT=82 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:56:20.050029 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d03197c2-3be9-47db-a87b-d32efedc4f78 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:20.050544 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d03197c2-3be9-47db-a87b-d32efedc4f78 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:20.050977 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d03197c2-3be9-47db-a87b-d32efedc4f78 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:20.051663 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d03197c2-3be9-47db-a87b-d32efedc4f78 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:20.052114 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d03197c2-3be9-47db-a87b-d32efedc4f78 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:20.052565 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d03197c2-3be9-47db-a87b-d32efedc4f78 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:20.139037 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-6a4154a0-d595-48c2-a8cd-9a3c9cab8be8 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:20.139700 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-6a4154a0-d595-48c2-a8cd-9a3c9cab8be8 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:20.146893 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6a4154a0-d595-48c2-a8cd-9a3c9cab8be8 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:20.147414 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6a4154a0-d595-48c2-a8cd-9a3c9cab8be8 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:20.148415 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6a4154a0-d595-48c2-a8cd-9a3c9cab8be8 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:20.149151 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6a4154a0-d595-48c2-a8cd-9a3c9cab8be8 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:20.149904 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6a4154a0-d595-48c2-a8cd-9a3c9cab8be8 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:20.150342 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6a4154a0-d595-48c2-a8cd-9a3c9cab8be8 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:20.189662 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-d03197c2-3be9-47db-a87b-d32efedc4f78 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:20.197911 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-d03197c2-3be9-47db-a87b-d32efedc4f78 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:20.199377 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-d03197c2-3be9-47db-a87b-d32efedc4f78 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:20.200647 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-d03197c2-3be9-47db-a87b-d32efedc4f78 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1744 microversion: 2.20 time: 0.162503 Aug 26 00:56:20.203511 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 183/376] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:56:20 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1744 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:56:20.291301 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-6a4154a0-d595-48c2-a8cd-9a3c9cab8be8 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:20.299856 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-6a4154a0-d595-48c2-a8cd-9a3c9cab8be8 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab" status: 200 len: 1510 microversion: 2.1 time: 0.164642 Aug 26 00:56:20.308682 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 194/377] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:20 2022] GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab => generated 1510 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:56:20.442134 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-89cba3e4-36ce-4d46-b43d-e9220a87107c tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:20.443017 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-89cba3e4-36ce-4d46-b43d-e9220a87107c tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: c56d5f8c-767e-4fa6-b714-d018853c73bd] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:20.450051 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-89cba3e4-36ce-4d46-b43d-e9220a87107c tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:20.450931 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-89cba3e4-36ce-4d46-b43d-e9220a87107c tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:20.451645 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-89cba3e4-36ce-4d46-b43d-e9220a87107c tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:20.452611 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-89cba3e4-36ce-4d46-b43d-e9220a87107c tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:20.453235 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-89cba3e4-36ce-4d46-b43d-e9220a87107c tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:20.453735 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-89cba3e4-36ce-4d46-b43d-e9220a87107c tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:20.495571 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-89cba3e4-36ce-4d46-b43d-e9220a87107c tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:20.496119 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-89cba3e4-36ce-4d46-b43d-e9220a87107c tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:20.496605 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-89cba3e4-36ce-4d46-b43d-e9220a87107c tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:20.497052 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.objects.instance [None req-89cba3e4-36ce-4d46-b43d-e9220a87107c tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lazy-loading 'fault' on Instance uuid c56d5f8c-767e-4fa6-b714-d018853c73bd {{(pid=127565) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 00:56:20.544648 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-89cba3e4-36ce-4d46-b43d-e9220a87107c tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93774232c1479aa3e856bffb352140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b49ff217de14a2aae05d524128dec49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:20.553823 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-89cba3e4-36ce-4d46-b43d-e9220a87107c tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] 10.222.0.59 "GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd" status: 200 len: 1304 microversion: 2.1 time: 0.116654 Aug 26 00:56:20.556551 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 184/378] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:20 2022] GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd => generated 1304 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:20.598527 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [req-a8005f55-211e-4d7f-a419-1c62ffe9f857 req-1fdcb3da-9395-4ccd-8726-a0694ca8f2c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7502d0cf-4abc-484b-8c85-d8ea6682333b", "name": "network-vif-plugged", "status": "completed", "tag": "ee6ad2fb-f57e-474d-a46b-a0d19ae36479"}]} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:56:20.607798 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-a8005f55-211e-4d7f-a419-1c62ffe9f857 req-1fdcb3da-9395-4ccd-8726-a0694ca8f2c5 service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:20.608249 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-a8005f55-211e-4d7f-a419-1c62ffe9f857 req-1fdcb3da-9395-4ccd-8726-a0694ca8f2c5 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:20.608706 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-a8005f55-211e-4d7f-a419-1c62ffe9f857 req-1fdcb3da-9395-4ccd-8726-a0694ca8f2c5 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:20.620343 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.compute.server_external_events [req-a8005f55-211e-4d7f-a419-1c62ffe9f857 req-1fdcb3da-9395-4ccd-8726-a0694ca8f2c5 service nova] Creating event network-vif-plugged:ee6ad2fb-f57e-474d-a46b-a0d19ae36479 for instance 7502d0cf-4abc-484b-8c85-d8ea6682333b on hv-cinder-83538 Aug 26 00:56:20.625135 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [req-a8005f55-211e-4d7f-a419-1c62ffe9f857 req-1fdcb3da-9395-4ccd-8726-a0694ca8f2c5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030743 Aug 26 00:56:20.625779 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 195/379] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 00:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:56:20.860595 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-d1c8fa71-06c3-4d71-9def-a74fe2110da7 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:20.861824 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-d1c8fa71-06c3-4d71-9def-a74fe2110da7 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:20.868616 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d1c8fa71-06c3-4d71-9def-a74fe2110da7 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:20.869257 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d1c8fa71-06c3-4d71-9def-a74fe2110da7 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:20.869780 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d1c8fa71-06c3-4d71-9def-a74fe2110da7 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:20.870538 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d1c8fa71-06c3-4d71-9def-a74fe2110da7 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:20.871047 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d1c8fa71-06c3-4d71-9def-a74fe2110da7 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:20.871530 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d1c8fa71-06c3-4d71-9def-a74fe2110da7 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:21.007970 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-d1c8fa71-06c3-4d71-9def-a74fe2110da7 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:21.016555 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-d1c8fa71-06c3-4d71-9def-a74fe2110da7 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1721 microversion: 2.1 time: 0.162246 Aug 26 00:56:21.017655 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 185/380] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:20 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:56:21.226375 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-4f52ed55-7e6e-44db-802b-097a2dc0937e tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:21.227102 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-4f52ed55-7e6e-44db-802b-097a2dc0937e tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:21.233463 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-4f52ed55-7e6e-44db-802b-097a2dc0937e tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:21.234000 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-4f52ed55-7e6e-44db-802b-097a2dc0937e tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:21.234313 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-4f52ed55-7e6e-44db-802b-097a2dc0937e tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:21.235004 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-4f52ed55-7e6e-44db-802b-097a2dc0937e tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:21.235454 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-4f52ed55-7e6e-44db-802b-097a2dc0937e tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:21.236245 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-4f52ed55-7e6e-44db-802b-097a2dc0937e tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:21.328676 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-1db8b636-7e16-4d1b-95e4-7f1c2939d13a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:21.332937 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-1db8b636-7e16-4d1b-95e4-7f1c2939d13a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:21.350790 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1db8b636-7e16-4d1b-95e4-7f1c2939d13a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:21.351281 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1db8b636-7e16-4d1b-95e4-7f1c2939d13a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:21.351969 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1db8b636-7e16-4d1b-95e4-7f1c2939d13a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:21.355100 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1db8b636-7e16-4d1b-95e4-7f1c2939d13a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:21.355779 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1db8b636-7e16-4d1b-95e4-7f1c2939d13a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:21.356413 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1db8b636-7e16-4d1b-95e4-7f1c2939d13a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:21.392196 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-4f52ed55-7e6e-44db-802b-097a2dc0937e tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:21.430278 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-4f52ed55-7e6e-44db-802b-097a2dc0937e tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:21.431181 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-4f52ed55-7e6e-44db-802b-097a2dc0937e tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:21.432771 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-4f52ed55-7e6e-44db-802b-097a2dc0937e tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1744 microversion: 2.20 time: 0.210491 Aug 26 00:56:21.433495 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 196/381] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:56:21 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1744 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 00:56:21.542252 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-1db8b636-7e16-4d1b-95e4-7f1c2939d13a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:21.550100 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-dc29c1e1-ad0b-476e-bb92-c2ae01de6e44 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1690568545", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1867992654", "security_groups": [{"name": "tempest-secgroup-smoke-1310762645"}], "block_device_mapping_v2": [{"uuid": "8ee31a97-4f95-44ad-9fcc-c64ee2618ef3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "67cce745-2ab6-4c41-99b3-cb2978e1bfd5"}]}} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:56:21.550957 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-1db8b636-7e16-4d1b-95e4-7f1c2939d13a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab" status: 200 len: 1510 microversion: 2.1 time: 0.230300 Aug 26 00:56:21.551934 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 186/382] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:21 2022] GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab => generated 1510 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:21.575079 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-3ddecf03-9bf2-4560-89e8-2a868b86e753 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:21.575761 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-3ddecf03-9bf2-4560-89e8-2a868b86e753 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: c56d5f8c-767e-4fa6-b714-d018853c73bd] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:21.582752 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3ddecf03-9bf2-4560-89e8-2a868b86e753 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:21.583323 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3ddecf03-9bf2-4560-89e8-2a868b86e753 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:21.583853 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3ddecf03-9bf2-4560-89e8-2a868b86e753 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:21.584678 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3ddecf03-9bf2-4560-89e8-2a868b86e753 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:21.585242 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3ddecf03-9bf2-4560-89e8-2a868b86e753 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:21.585762 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3ddecf03-9bf2-4560-89e8-2a868b86e753 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:21.683990 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.network.neutron [None req-dc29c1e1-ad0b-476e-bb92-c2ae01de6e44 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] validate_networks() for [('67cce745-2ab6-4c41-99b3-cb2978e1bfd5', None, None, None, None, None)] {{(pid=127564) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 00:56:21.805526 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3ddecf03-9bf2-4560-89e8-2a868b86e753 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:21.806023 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3ddecf03-9bf2-4560-89e8-2a868b86e753 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:21.806463 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3ddecf03-9bf2-4560-89e8-2a868b86e753 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:21.806970 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.objects.instance [None req-3ddecf03-9bf2-4560-89e8-2a868b86e753 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lazy-loading 'fault' on Instance uuid c56d5f8c-767e-4fa6-b714-d018853c73bd {{(pid=127565) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 00:56:21.810208 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:56:21.849668 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-3ddecf03-9bf2-4560-89e8-2a868b86e753 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93774232c1479aa3e856bffb352140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b49ff217de14a2aae05d524128dec49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:21.860356 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-3ddecf03-9bf2-4560-89e8-2a868b86e753 tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] 10.222.0.59 "GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd" status: 200 len: 1304 microversion: 2.1 time: 0.288735 Aug 26 00:56:21.861892 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 187/383] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:21 2022] GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd => generated 1304 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:22.038841 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-c3e91689-a265-4b00-a5d8-aab37f93f751 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:22.039786 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-c3e91689-a265-4b00-a5d8-aab37f93f751 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:22.046473 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c3e91689-a265-4b00-a5d8-aab37f93f751 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:22.052056 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c3e91689-a265-4b00-a5d8-aab37f93f751 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:22.052056 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c3e91689-a265-4b00-a5d8-aab37f93f751 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:22.052056 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c3e91689-a265-4b00-a5d8-aab37f93f751 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:22.052056 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c3e91689-a265-4b00-a5d8-aab37f93f751 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:22.052375 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c3e91689-a265-4b00-a5d8-aab37f93f751 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:22.074034 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.virt.hardware [None req-dc29c1e1-ad0b-476e-bb92-c2ae01de6e44 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Flavor limits 0:0:0 {{(pid=127564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 00:56:22.074515 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.virt.hardware [None req-dc29c1e1-ad0b-476e-bb92-c2ae01de6e44 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Image limits 0:0:0 {{(pid=127564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 00:56:22.074970 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.virt.hardware [None req-dc29c1e1-ad0b-476e-bb92-c2ae01de6e44 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Flavor pref 0:0:0 {{(pid=127564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 00:56:22.075378 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.virt.hardware [None req-dc29c1e1-ad0b-476e-bb92-c2ae01de6e44 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Image pref 0:0:0 {{(pid=127564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 00:56:22.075780 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.virt.hardware [None req-dc29c1e1-ad0b-476e-bb92-c2ae01de6e44 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 00:56:22.085300 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-dc29c1e1-ad0b-476e-bb92-c2ae01de6e44 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:22.086010 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-dc29c1e1-ad0b-476e-bb92-c2ae01de6e44 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:22.086625 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-dc29c1e1-ad0b-476e-bb92-c2ae01de6e44 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:22.087727 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-dc29c1e1-ad0b-476e-bb92-c2ae01de6e44 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:22.088346 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-dc29c1e1-ad0b-476e-bb92-c2ae01de6e44 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:22.088945 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-dc29c1e1-ad0b-476e-bb92-c2ae01de6e44 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:22.111880 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.quota [None req-dc29c1e1-ad0b-476e-bb92-c2ae01de6e44 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Getting quotas for project ca3e24d51bdf44c5ad7219fa57d3d23b. Resources: {'instances', 'ram', 'cores'} {{(pid=127564) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 00:56:22.116605 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.quota [None req-dc29c1e1-ad0b-476e-bb92-c2ae01de6e44 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Getting quotas for user cd45f1813efc4926a30454aaa108ac47 and project ca3e24d51bdf44c5ad7219fa57d3d23b. Resources: {'instances', 'ram', 'cores'} {{(pid=127564) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 00:56:22.191699 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-dc29c1e1-ad0b-476e-bb92-c2ae01de6e44 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Going to run 1 instances... {{(pid=127564) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 00:56:22.194342 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-dc29c1e1-ad0b-476e-bb92-c2ae01de6e44 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: cc9ceee0-65b5-48be-8dcc-7ec2a992f72d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8ee31a97-4f95-44ad-9fcc-c64ee2618ef3',volume_size=None,volume_type=None)] {{(pid=127564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 00:56:22.239419 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-c3e91689-a265-4b00-a5d8-aab37f93f751 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:22.248612 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-c3e91689-a265-4b00-a5d8-aab37f93f751 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1721 microversion: 2.1 time: 0.213363 Aug 26 00:56:22.252559 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 188/384] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:22 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1721 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:56:22.457850 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-e7d0336f-8c7f-4b87-85d6-e374d88d77e5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:22.460759 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-e7d0336f-8c7f-4b87-85d6-e374d88d77e5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:22.465859 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e7d0336f-8c7f-4b87-85d6-e374d88d77e5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:22.466349 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e7d0336f-8c7f-4b87-85d6-e374d88d77e5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:22.466790 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e7d0336f-8c7f-4b87-85d6-e374d88d77e5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:22.467483 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e7d0336f-8c7f-4b87-85d6-e374d88d77e5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:22.469729 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e7d0336f-8c7f-4b87-85d6-e374d88d77e5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:22.470421 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e7d0336f-8c7f-4b87-85d6-e374d88d77e5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:22.620679 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-e7d0336f-8c7f-4b87-85d6-e374d88d77e5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:22.628928 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-e7d0336f-8c7f-4b87-85d6-e374d88d77e5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:22.630362 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-e7d0336f-8c7f-4b87-85d6-e374d88d77e5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:22.631510 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-e7d0336f-8c7f-4b87-85d6-e374d88d77e5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1744 microversion: 2.20 time: 0.179098 Aug 26 00:56:22.632064 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 189/385] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:56:22 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1744 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:56:22.636325 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-83ed713b-3f16-4940-9eff-f3f219230054 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:22.636957 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-83ed713b-3f16-4940-9eff-f3f219230054 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:22.642579 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-83ed713b-3f16-4940-9eff-f3f219230054 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:22.643057 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-83ed713b-3f16-4940-9eff-f3f219230054 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:22.643490 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-83ed713b-3f16-4940-9eff-f3f219230054 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:22.644170 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-83ed713b-3f16-4940-9eff-f3f219230054 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:22.644654 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-83ed713b-3f16-4940-9eff-f3f219230054 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:22.645077 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-83ed713b-3f16-4940-9eff-f3f219230054 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:22.773892 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-dc29c1e1-ad0b-476e-bb92-c2ae01de6e44 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.231441 Aug 26 00:56:22.775137 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 197/386] 10.222.0.59 () {60 vars in 1147 bytes} [Fri Aug 26 00:56:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 1233 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 00:56:22.786245 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-83ed713b-3f16-4940-9eff-f3f219230054 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:22.787986 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-b45b970a-d376-4dd2-be8d-04119dfecbff tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:22.788795 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-b45b970a-d376-4dd2-be8d-04119dfecbff tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: cc9ceee0-65b5-48be-8dcc-7ec2a992f72d] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:22.795467 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-83ed713b-3f16-4940-9eff-f3f219230054 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab" status: 200 len: 1516 microversion: 2.1 time: 0.162191 Aug 26 00:56:22.796802 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 190/387] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:22 2022] GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab => generated 1516 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:22.879715 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-b45b970a-d376-4dd2-be8d-04119dfecbff tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:22.887407 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-abc2ef65-9002-4bca-937b-ea60b760dd6b tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:22.888072 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-abc2ef65-9002-4bca-937b-ea60b760dd6b tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: c56d5f8c-767e-4fa6-b714-d018853c73bd] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:22.889212 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-b45b970a-d376-4dd2-be8d-04119dfecbff tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d" status: 200 len: 1095 microversion: 2.1 time: 0.106839 Aug 26 00:56:22.890481 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 198/388] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:22 2022] GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d => generated 1095 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:56:22.899545 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-abc2ef65-9002-4bca-937b-ea60b760dd6b tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:22.900051 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-abc2ef65-9002-4bca-937b-ea60b760dd6b tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:22.901599 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-abc2ef65-9002-4bca-937b-ea60b760dd6b tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:22.904588 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-abc2ef65-9002-4bca-937b-ea60b760dd6b tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:22.905090 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-abc2ef65-9002-4bca-937b-ea60b760dd6b tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:22.905529 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-abc2ef65-9002-4bca-937b-ea60b760dd6b tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:22.947609 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-abc2ef65-9002-4bca-937b-ea60b760dd6b tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:22.948031 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-abc2ef65-9002-4bca-937b-ea60b760dd6b tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:22.948498 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-abc2ef65-9002-4bca-937b-ea60b760dd6b tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:22.948953 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.objects.instance [None req-abc2ef65-9002-4bca-937b-ea60b760dd6b tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lazy-loading 'fault' on Instance uuid c56d5f8c-767e-4fa6-b714-d018853c73bd {{(pid=127565) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 00:56:23.011999 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-abc2ef65-9002-4bca-937b-ea60b760dd6b tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93774232c1479aa3e856bffb352140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b49ff217de14a2aae05d524128dec49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:23.022612 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-abc2ef65-9002-4bca-937b-ea60b760dd6b tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] 10.222.0.59 "GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd" status: 200 len: 1304 microversion: 2.1 time: 0.144579 Aug 26 00:56:23.024131 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 191/389] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:22 2022] GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd => generated 1304 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:56:23.271228 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-46c3ada8-575b-4634-9d0c-09db5c3d786f tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:23.271770 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-46c3ada8-575b-4634-9d0c-09db5c3d786f tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:23.279539 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-46c3ada8-575b-4634-9d0c-09db5c3d786f tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:23.279955 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-46c3ada8-575b-4634-9d0c-09db5c3d786f tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:23.280400 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-46c3ada8-575b-4634-9d0c-09db5c3d786f tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:23.281774 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-46c3ada8-575b-4634-9d0c-09db5c3d786f tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:23.282234 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-46c3ada8-575b-4634-9d0c-09db5c3d786f tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:23.282862 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-46c3ada8-575b-4634-9d0c-09db5c3d786f tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:23.477282 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-46c3ada8-575b-4634-9d0c-09db5c3d786f tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:23.486924 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-46c3ada8-575b-4634-9d0c-09db5c3d786f tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1721 microversion: 2.1 time: 0.221175 Aug 26 00:56:23.488089 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 199/390] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:23 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1721 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:23.654949 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-684a2371-de88-4218-ab08-422051d71fad tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:23.655730 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-684a2371-de88-4218-ab08-422051d71fad tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:23.662450 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-684a2371-de88-4218-ab08-422051d71fad tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:23.662930 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-684a2371-de88-4218-ab08-422051d71fad tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:23.663349 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-684a2371-de88-4218-ab08-422051d71fad tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:23.672094 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-684a2371-de88-4218-ab08-422051d71fad tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:23.672680 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-684a2371-de88-4218-ab08-422051d71fad tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:23.674574 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-684a2371-de88-4218-ab08-422051d71fad tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:23.827802 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-684a2371-de88-4218-ab08-422051d71fad tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:23.853869 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-684a2371-de88-4218-ab08-422051d71fad tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:23.855702 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-684a2371-de88-4218-ab08-422051d71fad tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:23.869736 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-684a2371-de88-4218-ab08-422051d71fad tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1739 microversion: 2.20 time: 0.218500 Aug 26 00:56:23.871186 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 192/391] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:56:23 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1739 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:56:23.913601 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-91bc8c9c-1f43-4ab7-a1b8-ec16c1ef3d9e tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:23.915112 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-91bc8c9c-1f43-4ab7-a1b8-ec16c1ef3d9e tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: cc9ceee0-65b5-48be-8dcc-7ec2a992f72d] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:24.018455 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-91bc8c9c-1f43-4ab7-a1b8-ec16c1ef3d9e tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:24.033558 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-91bc8c9c-1f43-4ab7-a1b8-ec16c1ef3d9e tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d" status: 200 len: 1095 microversion: 2.1 time: 0.124039 Aug 26 00:56:24.044502 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 200/392] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:23 2022] GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d => generated 1095 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:56:24.045568 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-c1d686ea-75e3-481c-8640-3a6afed9c04c tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:24.046179 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-c1d686ea-75e3-481c-8640-3a6afed9c04c tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] [instance: c56d5f8c-767e-4fa6-b714-d018853c73bd] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:24.057075 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c1d686ea-75e3-481c-8640-3a6afed9c04c tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:24.057560 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c1d686ea-75e3-481c-8640-3a6afed9c04c tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:24.061070 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c1d686ea-75e3-481c-8640-3a6afed9c04c tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:24.062177 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c1d686ea-75e3-481c-8640-3a6afed9c04c tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:24.062800 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c1d686ea-75e3-481c-8640-3a6afed9c04c tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:24.064015 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c1d686ea-75e3-481c-8640-3a6afed9c04c tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:24.080536 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.wsgi [None req-c1d686ea-75e3-481c-8640-3a6afed9c04c tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] HTTP exception thrown: Instance c56d5f8c-767e-4fa6-b714-d018853c73bd could not be found. Aug 26 00:56:24.082388 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-c1d686ea-75e3-481c-8640-3a6afed9c04c tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Request method failure captured: Aug 26 00:56:24.082388 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: request: GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd HTTP/1.1 Aug 26 00:56:24.082388 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Accept: application/json Aug 26 00:56:24.082388 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Accept-Encoding: identity Aug 26 00:56:24.082388 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Connection: close Aug 26 00:56:24.082388 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Content-Length: 0 Aug 26 00:56:24.082388 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Content-Type: application/json Aug 26 00:56:24.082388 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Host: 10.222.0.59 Aug 26 00:56:24.082388 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Openstack-System-Scope: None Aug 26 00:56:24.082388 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: User-Agent: python-urllib3/1.26.11 Aug 26 00:56:24.082388 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Auth-Token: gAAAAABjCBntts7oqcr5trZblssAxA8cXRmmy1X4k6fcnwQ0VzWAxvhP1LKtgC8yKn_TK6EBsQ7sxmj_TwKMepxjtPfVlcKATo2harLKPRXSJotB4aBuvESk57u6x8MSJoD8ZXtfEoRVLcNTN_AFhzqmTXivCqpcdKzhVoZhsR8Lb6e04mMY3eA Aug 26 00:56:24.082388 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Domain-Id: None Aug 26 00:56:24.082388 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Domain-Name: None Aug 26 00:56:24.082388 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Identity-Status: Confirmed Aug 26 00:56:24.082388 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Is-Admin-Project: True Aug 26 00:56:24.082388 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Domain-Id: default Aug 26 00:56:24.082388 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Domain-Name: Default Aug 26 00:56:24.082388 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Id: 9b49ff217de14a2aae05d524128dec49 Aug 26 00:56:24.082388 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Name: tempest-VolumesActionsTest-746620721 Aug 26 00:56:24.082388 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Role: reader,member Aug 26 00:56:24.082388 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Roles: reader,member Aug 26 00:56:24.083826 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9b49ff217de14a2aae05d524128dec49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9b49ff217de14a2aae05d524128dec49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9b49ff217de14a2aae05d524128dec49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9b49ff217de14a2aae05d524128dec49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 00:56:24.083826 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant: tempest-VolumesActionsTest-746620721 Aug 26 00:56:24.083826 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant-Id: 9b49ff217de14a2aae05d524128dec49 Aug 26 00:56:24.083826 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant-Name: tempest-VolumesActionsTest-746620721 Aug 26 00:56:24.083826 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User: tempest-VolumesActionsTest-746620721-project Aug 26 00:56:24.083826 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Domain-Id: default Aug 26 00:56:24.083826 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Domain-Name: Default Aug 26 00:56:24.083826 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Id: 2f93774232c1479aa3e856bffb352140 Aug 26 00:56:24.083826 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Name: tempest-VolumesActionsTest-746620721-project Aug 26 00:56:24.083826 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: method: > Aug 26 00:56:24.083826 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: exception: Instance c56d5f8c-767e-4fa6-b714-d018853c73bd could not be found. Aug 26 00:56:24.083826 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: action_args: {'id': 'c56d5f8c-767e-4fa6-b714-d018853c73bd'} Aug 26 00:56:24.084667 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 00:56:24.084667 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:56:24.084667 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 00:56:24.084667 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 00:56:24.084667 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 00:56:24.084667 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 00:56:24.084667 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 00:56:24.084667 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 00:56:24.084667 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 00:56:24.084667 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 00:56:24.084667 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c56d5f8c-767e-4fa6-b714-d018853c73bd could not be found. Aug 26 00:56:24.084667 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:56:24.084667 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 00:56:24.084667 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:56:24.084667 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:56:24.084667 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 00:56:24.084667 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 00:56:24.084667 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 00:56:24.084667 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 00:56:24.084667 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 00:56:24.086010 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 00:56:24.086010 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 00:56:24.086010 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 00:56:24.086010 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 00:56:24.086010 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 00:56:24.086010 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 00:56:24.086010 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 00:56:24.086010 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c56d5f8c-767e-4fa6-b714-d018853c73bd could not be found. Aug 26 00:56:24.086010 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:56:24.086010 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 00:56:24.086010 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:56:24.086010 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:56:24.086010 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 00:56:24.086010 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 00:56:24.086010 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 00:56:24.086010 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 00:56:24.086010 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c56d5f8c-767e-4fa6-b714-d018853c73bd could not be found. Aug 26 00:56:24.086010 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:56:24.088170 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-c1d686ea-75e3-481c-8640-3a6afed9c04c tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] Returning 404 to user: Instance c56d5f8c-767e-4fa6-b714-d018853c73bd could not be found. {{(pid=127565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 00:56:24.089056 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-c1d686ea-75e3-481c-8640-3a6afed9c04c tempest-VolumesActionsTest-746620721 tempest-VolumesActionsTest-746620721-project] 10.222.0.59 "GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd" status: 404 len: 111 microversion: 2.1 time: 0.047532 Aug 26 00:56:24.089772 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 193/393] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:24 2022] GET /compute/v2.1/servers/c56d5f8c-767e-4fa6-b714-d018853c73bd => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 00:56:24.522383 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-a18b42de-229e-4823-9e4f-056bc8f96c32 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:24.523919 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-a18b42de-229e-4823-9e4f-056bc8f96c32 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:24.534218 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a18b42de-229e-4823-9e4f-056bc8f96c32 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:24.535151 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a18b42de-229e-4823-9e4f-056bc8f96c32 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:24.536304 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a18b42de-229e-4823-9e4f-056bc8f96c32 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:24.538047 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a18b42de-229e-4823-9e4f-056bc8f96c32 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:24.539450 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a18b42de-229e-4823-9e4f-056bc8f96c32 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:24.540260 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a18b42de-229e-4823-9e4f-056bc8f96c32 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:24.809161 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-726952af-4178-4e06-933b-7c7e73c78fe0 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Action: 'create', calling method: .version_select at 0x7f8a92e4f4c0>, body: {"keypair": {"name": "tempest-keypair-1636012465", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMpumBSGSeaqwNPwcHlmsrdx0JWEbZ731+rsF2MerInUyQLwfyXweAibzMpUpbaB9EjmkQVr/PsElAfmY9TapyL5bbmP4QQOh+5pTxnYlJ8Y//Pks8e1Q5jZ+Za+uWs0w=="}} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:56:24.812593 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-a18b42de-229e-4823-9e4f-056bc8f96c32 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:24.823550 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-a18b42de-229e-4823-9e4f-056bc8f96c32 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1721 microversion: 2.1 time: 0.312663 Aug 26 00:56:24.824541 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 201/394] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:24 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1721 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:24.843527 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.quota [None req-726952af-4178-4e06-933b-7c7e73c78fe0 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Getting quotas for project 368f6a9e030e4aff9ef6559a6a165975. Resources: {'key_pairs'} {{(pid=127565) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 00:56:24.848290 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.quota [None req-726952af-4178-4e06-933b-7c7e73c78fe0 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Getting quotas for user 0cc36def73aa4bedb9e79d4cf11f5e8c and project 368f6a9e030e4aff9ef6559a6a165975. Resources: {'key_pairs'} {{(pid=127565) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 00:56:24.904882 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-de27e463-c0e1-4e7b-8006-d29f1362ea71 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:24.906732 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-de27e463-c0e1-4e7b-8006-d29f1362ea71 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:24.918654 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-de27e463-c0e1-4e7b-8006-d29f1362ea71 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:24.919886 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-de27e463-c0e1-4e7b-8006-d29f1362ea71 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:24.920544 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-de27e463-c0e1-4e7b-8006-d29f1362ea71 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:24.921438 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-de27e463-c0e1-4e7b-8006-d29f1362ea71 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:24.922052 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-de27e463-c0e1-4e7b-8006-d29f1362ea71 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:24.922481 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-de27e463-c0e1-4e7b-8006-d29f1362ea71 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:25.119139 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-726952af-4178-4e06-933b-7c7e73c78fe0 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.313545 Aug 26 00:56:25.122031 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 194/395] 10.222.0.59 () {60 vars in 1159 bytes} [Fri Aug 26 00:56:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 00:56:25.129253 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-de27e463-c0e1-4e7b-8006-d29f1362ea71 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:25.138597 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-de27e463-c0e1-4e7b-8006-d29f1362ea71 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:25.143716 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-3a9ca4b2-fb33-4fd9-8ec6-6ed88d66b671 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:25.143716 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-3a9ca4b2-fb33-4fd9-8ec6-6ed88d66b671 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: cc9ceee0-65b5-48be-8dcc-7ec2a992f72d] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:25.143932 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-de27e463-c0e1-4e7b-8006-d29f1362ea71 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:25.143932 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-de27e463-c0e1-4e7b-8006-d29f1362ea71 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1739 microversion: 2.20 time: 0.241435 Aug 26 00:56:25.143932 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 202/396] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:56:24 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1739 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 00:56:25.171923 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3a9ca4b2-fb33-4fd9-8ec6-6ed88d66b671 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:25.177586 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3a9ca4b2-fb33-4fd9-8ec6-6ed88d66b671 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:25.178950 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3a9ca4b2-fb33-4fd9-8ec6-6ed88d66b671 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:25.182991 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3a9ca4b2-fb33-4fd9-8ec6-6ed88d66b671 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:25.183736 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3a9ca4b2-fb33-4fd9-8ec6-6ed88d66b671 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:25.186747 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3a9ca4b2-fb33-4fd9-8ec6-6ed88d66b671 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:25.337221 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-3a9ca4b2-fb33-4fd9-8ec6-6ed88d66b671 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:25.348965 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-3a9ca4b2-fb33-4fd9-8ec6-6ed88d66b671 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d" status: 200 len: 1145 microversion: 2.1 time: 0.225846 Aug 26 00:56:25.365182 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 195/397] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:25 2022] GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d => generated 1145 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:25.847944 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-fb85b050-56b3-4f0e-a362-8777fe14d42e tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:25.848577 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-fb85b050-56b3-4f0e-a362-8777fe14d42e tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:25.865099 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fb85b050-56b3-4f0e-a362-8777fe14d42e tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:25.865595 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fb85b050-56b3-4f0e-a362-8777fe14d42e tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:25.866029 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fb85b050-56b3-4f0e-a362-8777fe14d42e tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:25.866958 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fb85b050-56b3-4f0e-a362-8777fe14d42e tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:25.867303 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fb85b050-56b3-4f0e-a362-8777fe14d42e tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:25.867670 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fb85b050-56b3-4f0e-a362-8777fe14d42e tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:25.908893 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:56:26.117733 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-fb85b050-56b3-4f0e-a362-8777fe14d42e tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:26.129583 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-fb85b050-56b3-4f0e-a362-8777fe14d42e tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1721 microversion: 2.1 time: 0.285313 Aug 26 00:56:26.130652 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 203/398] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:25 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1721 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:26.173244 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-3bcd6314-3717-41a3-a7c8-f27764561e78 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:26.175050 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-3bcd6314-3717-41a3-a7c8-f27764561e78 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:26.184727 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3bcd6314-3717-41a3-a7c8-f27764561e78 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:26.185476 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3bcd6314-3717-41a3-a7c8-f27764561e78 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:26.186234 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3bcd6314-3717-41a3-a7c8-f27764561e78 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:26.187090 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3bcd6314-3717-41a3-a7c8-f27764561e78 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:26.187882 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3bcd6314-3717-41a3-a7c8-f27764561e78 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:26.188463 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3bcd6314-3717-41a3-a7c8-f27764561e78 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:26.368685 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-3bcd6314-3717-41a3-a7c8-f27764561e78 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:26.370496 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-6f284c8e-77e6-494a-8ceb-3fd434c7a06a tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:26.371096 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-6f284c8e-77e6-494a-8ceb-3fd434c7a06a tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: cc9ceee0-65b5-48be-8dcc-7ec2a992f72d] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:26.378835 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-3bcd6314-3717-41a3-a7c8-f27764561e78 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:26.383339 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-3bcd6314-3717-41a3-a7c8-f27764561e78 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:26.386283 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6f284c8e-77e6-494a-8ceb-3fd434c7a06a tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:26.386444 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-3bcd6314-3717-41a3-a7c8-f27764561e78 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1739 microversion: 2.20 time: 0.219750 Aug 26 00:56:26.386775 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6f284c8e-77e6-494a-8ceb-3fd434c7a06a tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:26.388992 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 196/399] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:56:26 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1739 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:56:26.405709 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6f284c8e-77e6-494a-8ceb-3fd434c7a06a tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:26.406822 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6f284c8e-77e6-494a-8ceb-3fd434c7a06a tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:26.411831 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6f284c8e-77e6-494a-8ceb-3fd434c7a06a tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:26.416291 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6f284c8e-77e6-494a-8ceb-3fd434c7a06a tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:26.529147 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-6f284c8e-77e6-494a-8ceb-3fd434c7a06a tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:26.538372 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-6f284c8e-77e6-494a-8ceb-3fd434c7a06a tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d" status: 200 len: 1193 microversion: 2.1 time: 0.171537 Aug 26 00:56:26.540221 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 204/400] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:26 2022] GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d => generated 1193 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:27.155312 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-303c5367-2fe7-4289-8e01-b995fd166122 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:27.155938 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-303c5367-2fe7-4289-8e01-b995fd166122 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:27.163307 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-303c5367-2fe7-4289-8e01-b995fd166122 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:27.163802 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-303c5367-2fe7-4289-8e01-b995fd166122 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:27.164232 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-303c5367-2fe7-4289-8e01-b995fd166122 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:27.164957 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-303c5367-2fe7-4289-8e01-b995fd166122 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:27.165401 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-303c5367-2fe7-4289-8e01-b995fd166122 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:27.165834 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-303c5367-2fe7-4289-8e01-b995fd166122 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:27.302116 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-303c5367-2fe7-4289-8e01-b995fd166122 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:27.310656 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-303c5367-2fe7-4289-8e01-b995fd166122 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1721 microversion: 2.1 time: 0.159173 Aug 26 00:56:27.311230 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 197/401] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:27 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:27.418509 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-fe1db735-6bd0-4825-a707-da0a0ca4d64a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:27.419117 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-fe1db735-6bd0-4825-a707-da0a0ca4d64a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:27.425395 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fe1db735-6bd0-4825-a707-da0a0ca4d64a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:27.425877 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fe1db735-6bd0-4825-a707-da0a0ca4d64a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:27.426312 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fe1db735-6bd0-4825-a707-da0a0ca4d64a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:27.427007 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fe1db735-6bd0-4825-a707-da0a0ca4d64a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:27.427540 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fe1db735-6bd0-4825-a707-da0a0ca4d64a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:27.428040 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fe1db735-6bd0-4825-a707-da0a0ca4d64a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:27.572504 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-85cb045d-2844-4be0-83d3-55567ae861c8 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:27.572504 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-85cb045d-2844-4be0-83d3-55567ae861c8 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: cc9ceee0-65b5-48be-8dcc-7ec2a992f72d] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:27.585146 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-85cb045d-2844-4be0-83d3-55567ae861c8 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:27.585711 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-85cb045d-2844-4be0-83d3-55567ae861c8 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:27.586160 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-85cb045d-2844-4be0-83d3-55567ae861c8 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:27.586895 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-85cb045d-2844-4be0-83d3-55567ae861c8 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:27.587351 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-85cb045d-2844-4be0-83d3-55567ae861c8 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:27.587777 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-85cb045d-2844-4be0-83d3-55567ae861c8 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:27.690811 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-85cb045d-2844-4be0-83d3-55567ae861c8 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:27.695785 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-fe1db735-6bd0-4825-a707-da0a0ca4d64a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:27.701805 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-85cb045d-2844-4be0-83d3-55567ae861c8 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d" status: 200 len: 1201 microversion: 2.1 time: 0.142482 Aug 26 00:56:27.718006 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-fe1db735-6bd0-4825-a707-da0a0ca4d64a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:27.721146 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-fe1db735-6bd0-4825-a707-da0a0ca4d64a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:27.723902 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 198/402] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:27 2022] GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d => generated 1201 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:27.727722 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-fe1db735-6bd0-4825-a707-da0a0ca4d64a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1739 microversion: 2.20 time: 0.309790 Aug 26 00:56:27.740648 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 205/403] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:56:27 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1739 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:56:28.335321 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-c1215b75-6685-40b7-a810-6ba108c00571 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:28.335955 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-c1215b75-6685-40b7-a810-6ba108c00571 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:28.353493 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c1215b75-6685-40b7-a810-6ba108c00571 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:28.354001 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c1215b75-6685-40b7-a810-6ba108c00571 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:28.356571 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c1215b75-6685-40b7-a810-6ba108c00571 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:28.356571 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c1215b75-6685-40b7-a810-6ba108c00571 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:28.356571 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c1215b75-6685-40b7-a810-6ba108c00571 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:28.356571 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c1215b75-6685-40b7-a810-6ba108c00571 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:28.534961 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-c1215b75-6685-40b7-a810-6ba108c00571 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:28.553984 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-c1215b75-6685-40b7-a810-6ba108c00571 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1721 microversion: 2.1 time: 0.225100 Aug 26 00:56:28.572392 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 199/404] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:28 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1721 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:28.722466 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-c2f8c030-ba27-407a-af08-9f1d77d86e64 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:28.723929 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-c2f8c030-ba27-407a-af08-9f1d77d86e64 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: cc9ceee0-65b5-48be-8dcc-7ec2a992f72d] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:28.732955 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c2f8c030-ba27-407a-af08-9f1d77d86e64 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:28.735668 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c2f8c030-ba27-407a-af08-9f1d77d86e64 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:28.736463 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c2f8c030-ba27-407a-af08-9f1d77d86e64 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:28.746988 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c2f8c030-ba27-407a-af08-9f1d77d86e64 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:28.750617 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c2f8c030-ba27-407a-af08-9f1d77d86e64 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:28.751883 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c2f8c030-ba27-407a-af08-9f1d77d86e64 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:28.764267 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-03e842fa-7047-473d-a12d-6403f8b65d8f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:28.764959 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-03e842fa-7047-473d-a12d-6403f8b65d8f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:28.776130 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-03e842fa-7047-473d-a12d-6403f8b65d8f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:28.777441 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-03e842fa-7047-473d-a12d-6403f8b65d8f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:28.777880 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-03e842fa-7047-473d-a12d-6403f8b65d8f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:28.778957 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-03e842fa-7047-473d-a12d-6403f8b65d8f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:28.779409 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-03e842fa-7047-473d-a12d-6403f8b65d8f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:28.781241 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-03e842fa-7047-473d-a12d-6403f8b65d8f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:28.857833 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-c2f8c030-ba27-407a-af08-9f1d77d86e64 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:28.868143 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-c2f8c030-ba27-407a-af08-9f1d77d86e64 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d" status: 200 len: 1201 microversion: 2.1 time: 0.149457 Aug 26 00:56:28.882690 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 206/405] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:28 2022] GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d => generated 1201 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:28.888397 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-101f7b71-0fa5-4ada-95b4-e955ce31807f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1407232245", "imageRef": "ef60327f-6e0c-4f85-8db9-6f6e8968fe9c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7609779d-30c3-4a34-917a-c632dbd6c083"}], "security_groups": [{"name": "tempest-securitygroup--1326608181"}], "key_name": "tempest-keypair-1636012465", "user_data": "}} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:56:28.956383 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-03e842fa-7047-473d-a12d-6403f8b65d8f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:28.965088 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-03e842fa-7047-473d-a12d-6403f8b65d8f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:28.966744 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-03e842fa-7047-473d-a12d-6403f8b65d8f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:28.968132 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-03e842fa-7047-473d-a12d-6403f8b65d8f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1739 microversion: 2.20 time: 0.216814 Aug 26 00:56:28.968864 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 200/406] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:56:28 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1739 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 00:56:29.031469 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.network.neutron [None req-101f7b71-0fa5-4ada-95b4-e955ce31807f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] validate_networks() for [('7609779d-30c3-4a34-917a-c632dbd6c083', None, None, None, None, None)] {{(pid=127564) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 00:56:29.495127 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.virt.hardware [None req-101f7b71-0fa5-4ada-95b4-e955ce31807f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Flavor limits 0:0:0 {{(pid=127564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 00:56:29.495806 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.virt.hardware [None req-101f7b71-0fa5-4ada-95b4-e955ce31807f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Image limits 0:0:0 {{(pid=127564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 00:56:29.496383 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.virt.hardware [None req-101f7b71-0fa5-4ada-95b4-e955ce31807f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Flavor pref 0:0:0 {{(pid=127564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 00:56:29.497064 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.virt.hardware [None req-101f7b71-0fa5-4ada-95b4-e955ce31807f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Image pref 0:0:0 {{(pid=127564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 00:56:29.497694 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.virt.hardware [None req-101f7b71-0fa5-4ada-95b4-e955ce31807f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 00:56:29.515820 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-101f7b71-0fa5-4ada-95b4-e955ce31807f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:29.516707 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-101f7b71-0fa5-4ada-95b4-e955ce31807f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:29.517983 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-101f7b71-0fa5-4ada-95b4-e955ce31807f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:29.518950 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-101f7b71-0fa5-4ada-95b4-e955ce31807f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:29.519553 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-101f7b71-0fa5-4ada-95b4-e955ce31807f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:29.520213 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-101f7b71-0fa5-4ada-95b4-e955ce31807f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:29.545555 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.quota [None req-101f7b71-0fa5-4ada-95b4-e955ce31807f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Getting quotas for project 368f6a9e030e4aff9ef6559a6a165975. Resources: {'instances', 'ram', 'cores'} {{(pid=127564) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 00:56:29.550285 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.quota [None req-101f7b71-0fa5-4ada-95b4-e955ce31807f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Getting quotas for user 0cc36def73aa4bedb9e79d4cf11f5e8c and project 368f6a9e030e4aff9ef6559a6a165975. Resources: {'instances', 'ram', 'cores'} {{(pid=127564) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 00:56:29.566712 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-101f7b71-0fa5-4ada-95b4-e955ce31807f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Going to run 1 instances... {{(pid=127564) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 00:56:29.569173 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-101f7b71-0fa5-4ada-95b4-e955ce31807f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ef60327f-6e0c-4f85-8db9-6f6e8968fe9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 00:56:29.576076 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-3806f1a0-1c46-4351-b90a-ffc258d018ad tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:29.577019 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-3806f1a0-1c46-4351-b90a-ffc258d018ad tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:29.592061 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3806f1a0-1c46-4351-b90a-ffc258d018ad tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:29.592951 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3806f1a0-1c46-4351-b90a-ffc258d018ad tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:29.594282 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3806f1a0-1c46-4351-b90a-ffc258d018ad tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:29.597210 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3806f1a0-1c46-4351-b90a-ffc258d018ad tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:29.597969 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3806f1a0-1c46-4351-b90a-ffc258d018ad tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:29.598677 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3806f1a0-1c46-4351-b90a-ffc258d018ad tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:29.711525 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-101f7b71-0fa5-4ada-95b4-e955ce31807f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.826930 Aug 26 00:56:29.718680 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 207/407] 10.222.0.59 () {60 vars in 1147 bytes} [Fri Aug 26 00:56:28 2022] POST /compute/v2.1/servers => generated 409 bytes in 835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 00:56:29.724678 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-060083ee-7270-41c0-a5c1-ef5ef739fc62 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:29.725979 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-060083ee-7270-41c0-a5c1-ef5ef739fc62 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:29.729384 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:56:29.831377 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-3806f1a0-1c46-4351-b90a-ffc258d018ad tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:29.841618 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-3806f1a0-1c46-4351-b90a-ffc258d018ad tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1721 microversion: 2.1 time: 0.270119 Aug 26 00:56:29.842856 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 201/408] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:29 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1721 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:29.888685 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-ad83da8c-3874-465b-aa3a-e98345b4a748 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:29.889303 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-ad83da8c-3874-465b-aa3a-e98345b4a748 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: cc9ceee0-65b5-48be-8dcc-7ec2a992f72d] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:29.892523 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-060083ee-7270-41c0-a5c1-ef5ef739fc62 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:29.900645 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-060083ee-7270-41c0-a5c1-ef5ef739fc62 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd" status: 200 len: 1246 microversion: 2.1 time: 0.180772 Aug 26 00:56:29.915921 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 208/409] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:29 2022] GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd => generated 1246 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:29.916163 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ad83da8c-3874-465b-aa3a-e98345b4a748 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:29.916714 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ad83da8c-3874-465b-aa3a-e98345b4a748 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:29.917153 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ad83da8c-3874-465b-aa3a-e98345b4a748 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:29.917860 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ad83da8c-3874-465b-aa3a-e98345b4a748 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:29.918537 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ad83da8c-3874-465b-aa3a-e98345b4a748 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:29.919123 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ad83da8c-3874-465b-aa3a-e98345b4a748 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:29.996461 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-fe103287-6ef1-41b7-9cff-7949b61cd4ff tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:29.997420 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-fe103287-6ef1-41b7-9cff-7949b61cd4ff tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:30.015943 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fe103287-6ef1-41b7-9cff-7949b61cd4ff tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:30.016928 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fe103287-6ef1-41b7-9cff-7949b61cd4ff tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:30.017528 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fe103287-6ef1-41b7-9cff-7949b61cd4ff tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:30.018422 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fe103287-6ef1-41b7-9cff-7949b61cd4ff tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:30.019024 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fe103287-6ef1-41b7-9cff-7949b61cd4ff tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:30.019621 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fe103287-6ef1-41b7-9cff-7949b61cd4ff tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:30.038239 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-ad83da8c-3874-465b-aa3a-e98345b4a748 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:30.052987 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-ad83da8c-3874-465b-aa3a-e98345b4a748 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d" status: 200 len: 1211 microversion: 2.1 time: 0.168041 Aug 26 00:56:30.072685 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 202/410] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:29 2022] GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d => generated 1211 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:30.210461 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-fe103287-6ef1-41b7-9cff-7949b61cd4ff tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:30.220359 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-fe103287-6ef1-41b7-9cff-7949b61cd4ff tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:30.226149 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-fe103287-6ef1-41b7-9cff-7949b61cd4ff tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:30.227901 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-fe103287-6ef1-41b7-9cff-7949b61cd4ff tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1739 microversion: 2.20 time: 0.235461 Aug 26 00:56:30.229753 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 209/411] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:56:29 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1739 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 00:56:30.864370 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-ab3177ee-b314-4a75-8484-cef4a614a503 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:30.865102 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-ab3177ee-b314-4a75-8484-cef4a614a503 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:30.873171 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ab3177ee-b314-4a75-8484-cef4a614a503 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:30.873782 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ab3177ee-b314-4a75-8484-cef4a614a503 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:30.874327 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ab3177ee-b314-4a75-8484-cef4a614a503 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:30.875108 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ab3177ee-b314-4a75-8484-cef4a614a503 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:30.875635 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ab3177ee-b314-4a75-8484-cef4a614a503 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:30.876550 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ab3177ee-b314-4a75-8484-cef4a614a503 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:30.920662 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-3421f8bf-d31b-4ac2-9905-cd642a7d8a75 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:30.921349 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-3421f8bf-d31b-4ac2-9905-cd642a7d8a75 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:30.984080 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-3421f8bf-d31b-4ac2-9905-cd642a7d8a75 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:30.996682 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-3421f8bf-d31b-4ac2-9905-cd642a7d8a75 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd" status: 200 len: 1246 microversion: 2.1 time: 0.075082 Aug 26 00:56:30.999487 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 210/412] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:30 2022] GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd => generated 1246 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:56:31.029043 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-ab3177ee-b314-4a75-8484-cef4a614a503 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:31.038029 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-ab3177ee-b314-4a75-8484-cef4a614a503 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1721 microversion: 2.1 time: 0.178754 Aug 26 00:56:31.038592 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 203/413] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:30 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:56:31.083557 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-3c779517-6662-4bb4-9a38-547f73ce6359 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:31.084172 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-3c779517-6662-4bb4-9a38-547f73ce6359 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: cc9ceee0-65b5-48be-8dcc-7ec2a992f72d] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:31.090165 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3c779517-6662-4bb4-9a38-547f73ce6359 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:31.090828 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3c779517-6662-4bb4-9a38-547f73ce6359 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:31.091261 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3c779517-6662-4bb4-9a38-547f73ce6359 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:31.091944 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3c779517-6662-4bb4-9a38-547f73ce6359 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:31.092390 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3c779517-6662-4bb4-9a38-547f73ce6359 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:31.093055 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3c779517-6662-4bb4-9a38-547f73ce6359 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:31.224029 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-3c779517-6662-4bb4-9a38-547f73ce6359 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:31.231588 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-3c779517-6662-4bb4-9a38-547f73ce6359 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d" status: 200 len: 1279 microversion: 2.1 time: 0.151915 Aug 26 00:56:31.232143 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 211/414] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:31 2022] GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d => generated 1279 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:31.255737 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-fff573d0-aae9-4b22-b3b2-a8b08c3dd3e5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:31.256441 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-fff573d0-aae9-4b22-b3b2-a8b08c3dd3e5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:31.262539 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-fff573d0-aae9-4b22-b3b2-a8b08c3dd3e5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:31.263025 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-fff573d0-aae9-4b22-b3b2-a8b08c3dd3e5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:31.263461 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-fff573d0-aae9-4b22-b3b2-a8b08c3dd3e5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:31.264148 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-fff573d0-aae9-4b22-b3b2-a8b08c3dd3e5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:31.264663 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-fff573d0-aae9-4b22-b3b2-a8b08c3dd3e5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:31.265092 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-fff573d0-aae9-4b22-b3b2-a8b08c3dd3e5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:31.401455 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-fff573d0-aae9-4b22-b3b2-a8b08c3dd3e5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:31.411845 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-fff573d0-aae9-4b22-b3b2-a8b08c3dd3e5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:31.413592 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-fff573d0-aae9-4b22-b3b2-a8b08c3dd3e5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:31.414741 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-fff573d0-aae9-4b22-b3b2-a8b08c3dd3e5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1739 microversion: 2.20 time: 0.163027 Aug 26 00:56:31.415298 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 204/415] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:56:31 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1739 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:56:32.022526 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-8c139fe7-fd79-4746-96bd-85dc46203954 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:32.023169 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-8c139fe7-fd79-4746-96bd-85dc46203954 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:32.029762 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8c139fe7-fd79-4746-96bd-85dc46203954 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:32.030459 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8c139fe7-fd79-4746-96bd-85dc46203954 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:32.031058 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8c139fe7-fd79-4746-96bd-85dc46203954 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:32.031875 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8c139fe7-fd79-4746-96bd-85dc46203954 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:32.032704 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8c139fe7-fd79-4746-96bd-85dc46203954 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:32.033635 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8c139fe7-fd79-4746-96bd-85dc46203954 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:32.059440 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-a2a8c4f2-d4da-4223-aa88-144d12425b77 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:32.060788 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-a2a8c4f2-d4da-4223-aa88-144d12425b77 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:32.067585 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a2a8c4f2-d4da-4223-aa88-144d12425b77 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:32.069021 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a2a8c4f2-d4da-4223-aa88-144d12425b77 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:32.069659 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a2a8c4f2-d4da-4223-aa88-144d12425b77 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:32.070573 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a2a8c4f2-d4da-4223-aa88-144d12425b77 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:32.071262 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a2a8c4f2-d4da-4223-aa88-144d12425b77 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:32.072101 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a2a8c4f2-d4da-4223-aa88-144d12425b77 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:32.093650 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell1:SELECT=100 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:56:32.121897 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-8c139fe7-fd79-4746-96bd-85dc46203954 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:32.131600 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-8c139fe7-fd79-4746-96bd-85dc46203954 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd" status: 200 len: 1250 microversion: 2.1 time: 0.112805 Aug 26 00:56:32.147523 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 212/416] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:32 2022] GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd => generated 1250 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:32.229812 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-a2a8c4f2-d4da-4223-aa88-144d12425b77 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:32.239988 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-a2a8c4f2-d4da-4223-aa88-144d12425b77 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1721 microversion: 2.1 time: 0.184545 Aug 26 00:56:32.240660 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 205/417] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:32 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1721 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:56:32.255819 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-8dd84df7-4073-4889-beb7-3dfbb4bd8885 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:32.256737 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-8dd84df7-4073-4889-beb7-3dfbb4bd8885 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: cc9ceee0-65b5-48be-8dcc-7ec2a992f72d] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:32.263577 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8dd84df7-4073-4889-beb7-3dfbb4bd8885 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:32.264267 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8dd84df7-4073-4889-beb7-3dfbb4bd8885 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:32.264921 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8dd84df7-4073-4889-beb7-3dfbb4bd8885 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:32.265813 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8dd84df7-4073-4889-beb7-3dfbb4bd8885 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:32.267318 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8dd84df7-4073-4889-beb7-3dfbb4bd8885 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:32.267821 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8dd84df7-4073-4889-beb7-3dfbb4bd8885 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:32.427157 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-8dd84df7-4073-4889-beb7-3dfbb4bd8885 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:32.440026 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-b5be9e35-a31f-4a0b-9060-8e6581368f28 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:32.441772 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-b5be9e35-a31f-4a0b-9060-8e6581368f28 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:32.447291 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-8dd84df7-4073-4889-beb7-3dfbb4bd8885 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d" status: 200 len: 1279 microversion: 2.1 time: 0.198852 Aug 26 00:56:32.451840 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b5be9e35-a31f-4a0b-9060-8e6581368f28 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:32.452142 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 213/418] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:32 2022] GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d => generated 1279 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:56:32.453396 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b5be9e35-a31f-4a0b-9060-8e6581368f28 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:32.453894 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b5be9e35-a31f-4a0b-9060-8e6581368f28 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:32.454747 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b5be9e35-a31f-4a0b-9060-8e6581368f28 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:32.455474 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b5be9e35-a31f-4a0b-9060-8e6581368f28 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:32.456006 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b5be9e35-a31f-4a0b-9060-8e6581368f28 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:32.615737 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-b5be9e35-a31f-4a0b-9060-8e6581368f28 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:32.627522 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-b5be9e35-a31f-4a0b-9060-8e6581368f28 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:32.629263 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-b5be9e35-a31f-4a0b-9060-8e6581368f28 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:32.630648 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-b5be9e35-a31f-4a0b-9060-8e6581368f28 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1739 microversion: 2.20 time: 0.194968 Aug 26 00:56:32.631624 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 206/419] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:56:32 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1739 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:56:33.152967 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-3df616ae-2a5c-4dee-842c-5ab4af562538 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:33.153485 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-3df616ae-2a5c-4dee-842c-5ab4af562538 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:33.161397 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3df616ae-2a5c-4dee-842c-5ab4af562538 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:33.161883 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3df616ae-2a5c-4dee-842c-5ab4af562538 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:33.162611 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3df616ae-2a5c-4dee-842c-5ab4af562538 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:33.163324 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3df616ae-2a5c-4dee-842c-5ab4af562538 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:33.163784 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3df616ae-2a5c-4dee-842c-5ab4af562538 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:33.164252 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3df616ae-2a5c-4dee-842c-5ab4af562538 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:33.261744 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-0e6f423d-5471-45f2-b884-5f7d733f2a16 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:33.262967 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-0e6f423d-5471-45f2-b884-5f7d733f2a16 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:33.272238 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0e6f423d-5471-45f2-b884-5f7d733f2a16 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:33.272824 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0e6f423d-5471-45f2-b884-5f7d733f2a16 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:33.273263 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0e6f423d-5471-45f2-b884-5f7d733f2a16 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:33.273972 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0e6f423d-5471-45f2-b884-5f7d733f2a16 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:33.274424 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0e6f423d-5471-45f2-b884-5f7d733f2a16 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:33.274845 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0e6f423d-5471-45f2-b884-5f7d733f2a16 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:33.308121 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-3df616ae-2a5c-4dee-842c-5ab4af562538 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:33.321047 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-3df616ae-2a5c-4dee-842c-5ab4af562538 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd" status: 200 len: 1250 microversion: 2.1 time: 0.170480 Aug 26 00:56:33.322494 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 214/420] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:33 2022] GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd => generated 1250 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:33.477189 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-80a05315-819b-4eb1-862d-096de2b8023e tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:33.477970 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-80a05315-819b-4eb1-862d-096de2b8023e tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: cc9ceee0-65b5-48be-8dcc-7ec2a992f72d] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:33.483853 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-80a05315-819b-4eb1-862d-096de2b8023e tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:33.484576 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-80a05315-819b-4eb1-862d-096de2b8023e tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:33.485251 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-80a05315-819b-4eb1-862d-096de2b8023e tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:33.486646 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-80a05315-819b-4eb1-862d-096de2b8023e tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:33.487115 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-80a05315-819b-4eb1-862d-096de2b8023e tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:33.487523 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-80a05315-819b-4eb1-862d-096de2b8023e tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:33.550937 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-0e6f423d-5471-45f2-b884-5f7d733f2a16 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:33.560583 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-0e6f423d-5471-45f2-b884-5f7d733f2a16 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1721 microversion: 2.1 time: 0.302528 Aug 26 00:56:33.561175 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 207/421] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:33 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1721 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:56:33.659722 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-70fb2258-42e0-4976-80df-243dd166ff89 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:33.660915 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-70fb2258-42e0-4976-80df-243dd166ff89 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:33.668680 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-70fb2258-42e0-4976-80df-243dd166ff89 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:33.669223 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-70fb2258-42e0-4976-80df-243dd166ff89 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:33.669728 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-70fb2258-42e0-4976-80df-243dd166ff89 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:33.670698 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-70fb2258-42e0-4976-80df-243dd166ff89 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:33.671237 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-70fb2258-42e0-4976-80df-243dd166ff89 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:33.671669 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-70fb2258-42e0-4976-80df-243dd166ff89 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:33.722704 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-80a05315-819b-4eb1-862d-096de2b8023e tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:33.734455 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-80a05315-819b-4eb1-862d-096de2b8023e tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d" status: 200 len: 1279 microversion: 2.1 time: 0.261208 Aug 26 00:56:33.749669 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 215/422] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:33 2022] GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d => generated 1279 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:56:33.876791 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-70fb2258-42e0-4976-80df-243dd166ff89 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:33.886085 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-70fb2258-42e0-4976-80df-243dd166ff89 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:33.887792 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-70fb2258-42e0-4976-80df-243dd166ff89 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:33.889896 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-70fb2258-42e0-4976-80df-243dd166ff89 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1739 microversion: 2.20 time: 0.235444 Aug 26 00:56:33.890893 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 208/423] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:56:33 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1739 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 00:56:34.087027 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [req-d78702c0-91b5-4f74-9e22-df31b906ceda req-e5f5ba05-61ba-47ba-9455-86d9ff8d01d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc9ceee0-65b5-48be-8dcc-7ec2a992f72d", "tag": "6f818c22-5eed-4378-90e3-cf3becc67582"}]} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:56:34.135733 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-d78702c0-91b5-4f74-9e22-df31b906ceda req-e5f5ba05-61ba-47ba-9455-86d9ff8d01d9 service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:34.136623 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-d78702c0-91b5-4f74-9e22-df31b906ceda req-e5f5ba05-61ba-47ba-9455-86d9ff8d01d9 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:34.137267 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-d78702c0-91b5-4f74-9e22-df31b906ceda req-e5f5ba05-61ba-47ba-9455-86d9ff8d01d9 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:34.157089 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.compute.server_external_events [req-d78702c0-91b5-4f74-9e22-df31b906ceda req-e5f5ba05-61ba-47ba-9455-86d9ff8d01d9 service nova] Creating event network-changed:6f818c22-5eed-4378-90e3-cf3becc67582 for instance cc9ceee0-65b5-48be-8dcc-7ec2a992f72d on hv-cinder-83538 Aug 26 00:56:34.163619 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [req-d78702c0-91b5-4f74-9e22-df31b906ceda req-e5f5ba05-61ba-47ba-9455-86d9ff8d01d9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092594 Aug 26 00:56:34.164911 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 216/424] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 00:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:56:34.344025 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-76cd0ea2-1ed1-4fed-abfb-d9ff30d5a68d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:34.344663 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-76cd0ea2-1ed1-4fed-abfb-d9ff30d5a68d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:34.351242 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-76cd0ea2-1ed1-4fed-abfb-d9ff30d5a68d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:34.351735 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-76cd0ea2-1ed1-4fed-abfb-d9ff30d5a68d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:34.352174 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-76cd0ea2-1ed1-4fed-abfb-d9ff30d5a68d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:34.352903 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-76cd0ea2-1ed1-4fed-abfb-d9ff30d5a68d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:34.353356 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-76cd0ea2-1ed1-4fed-abfb-d9ff30d5a68d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:34.353780 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-76cd0ea2-1ed1-4fed-abfb-d9ff30d5a68d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:34.419005 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-76cd0ea2-1ed1-4fed-abfb-d9ff30d5a68d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:34.427499 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-76cd0ea2-1ed1-4fed-abfb-d9ff30d5a68d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd" status: 200 len: 1298 microversion: 2.1 time: 0.087760 Aug 26 00:56:34.428073 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 209/425] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:34 2022] GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd => generated 1298 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:34.587562 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-80969be0-32db-47f6-bd80-5d130a91985f tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:34.588359 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-80969be0-32db-47f6-bd80-5d130a91985f tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:34.594804 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-80969be0-32db-47f6-bd80-5d130a91985f tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:34.595397 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-80969be0-32db-47f6-bd80-5d130a91985f tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:34.595927 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-80969be0-32db-47f6-bd80-5d130a91985f tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:34.596702 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-80969be0-32db-47f6-bd80-5d130a91985f tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:34.597160 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-80969be0-32db-47f6-bd80-5d130a91985f tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:34.597589 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-80969be0-32db-47f6-bd80-5d130a91985f tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:34.760597 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-44014010-d386-4369-b215-fc67d85a19d5 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:34.761210 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-44014010-d386-4369-b215-fc67d85a19d5 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: cc9ceee0-65b5-48be-8dcc-7ec2a992f72d] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:34.767843 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-44014010-d386-4369-b215-fc67d85a19d5 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:34.768286 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-44014010-d386-4369-b215-fc67d85a19d5 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:34.768899 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-44014010-d386-4369-b215-fc67d85a19d5 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:34.769602 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-44014010-d386-4369-b215-fc67d85a19d5 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:34.770333 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-44014010-d386-4369-b215-fc67d85a19d5 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:34.775538 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-44014010-d386-4369-b215-fc67d85a19d5 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:34.811907 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-80969be0-32db-47f6-bd80-5d130a91985f tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:34.839925 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-80969be0-32db-47f6-bd80-5d130a91985f tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1721 microversion: 2.1 time: 0.256605 Aug 26 00:56:34.858952 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 217/426] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:34 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1721 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:34.862062 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell0:SELECT=4 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:56:34.921309 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-3b3ddff7-09e1-405d-9f50-65f5f02a9628 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:34.924373 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-3b3ddff7-09e1-405d-9f50-65f5f02a9628 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:34.937894 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3b3ddff7-09e1-405d-9f50-65f5f02a9628 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:34.940673 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3b3ddff7-09e1-405d-9f50-65f5f02a9628 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:34.941219 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3b3ddff7-09e1-405d-9f50-65f5f02a9628 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:34.944111 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3b3ddff7-09e1-405d-9f50-65f5f02a9628 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:34.944801 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3b3ddff7-09e1-405d-9f50-65f5f02a9628 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:34.946376 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3b3ddff7-09e1-405d-9f50-65f5f02a9628 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:35.025965 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-44014010-d386-4369-b215-fc67d85a19d5 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:35.047199 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-44014010-d386-4369-b215-fc67d85a19d5 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d" status: 200 len: 1279 microversion: 2.1 time: 0.295701 Aug 26 00:56:35.047793 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 210/427] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:34 2022] GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d => generated 1279 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:56:35.326802 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-3b3ddff7-09e1-405d-9f50-65f5f02a9628 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:35.344722 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-3b3ddff7-09e1-405d-9f50-65f5f02a9628 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:35.346474 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-3b3ddff7-09e1-405d-9f50-65f5f02a9628 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:35.347659 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-3b3ddff7-09e1-405d-9f50-65f5f02a9628 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1739 microversion: 2.20 time: 0.432784 Aug 26 00:56:35.348212 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 218/428] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:56:34 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1739 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:56:35.452409 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-551c8510-fa62-4805-aea1-033230fa579a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:35.454035 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-551c8510-fa62-4805-aea1-033230fa579a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:35.486760 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-551c8510-fa62-4805-aea1-033230fa579a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:35.489221 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-551c8510-fa62-4805-aea1-033230fa579a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:35.491398 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-551c8510-fa62-4805-aea1-033230fa579a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:35.494073 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-551c8510-fa62-4805-aea1-033230fa579a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:35.495338 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-551c8510-fa62-4805-aea1-033230fa579a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:35.496120 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-551c8510-fa62-4805-aea1-033230fa579a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:35.709440 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-551c8510-fa62-4805-aea1-033230fa579a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:35.722066 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-551c8510-fa62-4805-aea1-033230fa579a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd" status: 200 len: 1316 microversion: 2.1 time: 0.275217 Aug 26 00:56:35.736669 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 211/429] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:35 2022] GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd => generated 1316 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:35.873583 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-6dc4fa79-424a-413d-9cd5-842e3f76fb34 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:35.873583 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-6dc4fa79-424a-413d-9cd5-842e3f76fb34 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:35.897473 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6dc4fa79-424a-413d-9cd5-842e3f76fb34 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:35.900442 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6dc4fa79-424a-413d-9cd5-842e3f76fb34 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:35.900979 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6dc4fa79-424a-413d-9cd5-842e3f76fb34 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:35.902338 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6dc4fa79-424a-413d-9cd5-842e3f76fb34 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:35.902338 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6dc4fa79-424a-413d-9cd5-842e3f76fb34 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:35.904901 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6dc4fa79-424a-413d-9cd5-842e3f76fb34 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:36.069323 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-934cbfbf-febb-4b09-8b61-f216afbd5dc2 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:36.070310 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-934cbfbf-febb-4b09-8b61-f216afbd5dc2 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: cc9ceee0-65b5-48be-8dcc-7ec2a992f72d] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:36.081399 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-934cbfbf-febb-4b09-8b61-f216afbd5dc2 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:36.088413 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-934cbfbf-febb-4b09-8b61-f216afbd5dc2 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:36.088413 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-934cbfbf-febb-4b09-8b61-f216afbd5dc2 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:36.088413 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-934cbfbf-febb-4b09-8b61-f216afbd5dc2 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:36.088413 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-934cbfbf-febb-4b09-8b61-f216afbd5dc2 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:36.089772 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-934cbfbf-febb-4b09-8b61-f216afbd5dc2 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:36.459904 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-934cbfbf-febb-4b09-8b61-f216afbd5dc2 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:36.471685 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-934cbfbf-febb-4b09-8b61-f216afbd5dc2 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d" status: 200 len: 1267 microversion: 2.1 time: 0.407843 Aug 26 00:56:36.474118 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 212/430] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:36 2022] GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d => generated 1267 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:56:36.478653 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-1c5576fa-3a4e-44ae-b4ac-9bd3a608a908 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:36.479269 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-1c5576fa-3a4e-44ae-b4ac-9bd3a608a908 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:36.482259 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-6dc4fa79-424a-413d-9cd5-842e3f76fb34 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:36.487137 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1c5576fa-3a4e-44ae-b4ac-9bd3a608a908 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:36.487278 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1c5576fa-3a4e-44ae-b4ac-9bd3a608a908 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:36.487666 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1c5576fa-3a4e-44ae-b4ac-9bd3a608a908 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:36.488603 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1c5576fa-3a4e-44ae-b4ac-9bd3a608a908 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:36.489060 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1c5576fa-3a4e-44ae-b4ac-9bd3a608a908 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:36.490675 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1c5576fa-3a4e-44ae-b4ac-9bd3a608a908 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:36.500099 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-6dc4fa79-424a-413d-9cd5-842e3f76fb34 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1721 microversion: 2.1 time: 0.637398 Aug 26 00:56:36.503320 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 219/431] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:35 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1721 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:36.709084 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-1c5576fa-3a4e-44ae-b4ac-9bd3a608a908 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:36.719182 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-1c5576fa-3a4e-44ae-b4ac-9bd3a608a908 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:36.722128 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-1c5576fa-3a4e-44ae-b4ac-9bd3a608a908 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:36.723529 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-1c5576fa-3a4e-44ae-b4ac-9bd3a608a908 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1739 microversion: 2.20 time: 0.248592 Aug 26 00:56:36.724598 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 213/432] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:56:36 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1739 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:56:36.747390 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-b41d7dd4-3b8b-461f-af67-35fffe940663 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:36.748128 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-b41d7dd4-3b8b-461f-af67-35fffe940663 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:36.758424 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b41d7dd4-3b8b-461f-af67-35fffe940663 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:36.759360 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b41d7dd4-3b8b-461f-af67-35fffe940663 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:36.761059 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b41d7dd4-3b8b-461f-af67-35fffe940663 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:36.761968 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b41d7dd4-3b8b-461f-af67-35fffe940663 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:36.762599 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b41d7dd4-3b8b-461f-af67-35fffe940663 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:36.763201 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b41d7dd4-3b8b-461f-af67-35fffe940663 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:36.861185 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-b41d7dd4-3b8b-461f-af67-35fffe940663 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:36.879092 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-b41d7dd4-3b8b-461f-af67-35fffe940663 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd" status: 200 len: 1304 microversion: 2.1 time: 0.134374 Aug 26 00:56:36.894379 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 220/433] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:36 2022] GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd => generated 1304 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:37.494847 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-463327a9-1b72-48e1-8f9d-9074ec364afa tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:37.495475 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-463327a9-1b72-48e1-8f9d-9074ec364afa tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: cc9ceee0-65b5-48be-8dcc-7ec2a992f72d] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:37.503137 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-463327a9-1b72-48e1-8f9d-9074ec364afa tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:37.503628 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-463327a9-1b72-48e1-8f9d-9074ec364afa tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:37.504061 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-463327a9-1b72-48e1-8f9d-9074ec364afa tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:37.504815 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-463327a9-1b72-48e1-8f9d-9074ec364afa tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:37.505248 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-463327a9-1b72-48e1-8f9d-9074ec364afa tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:37.505681 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-463327a9-1b72-48e1-8f9d-9074ec364afa tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:37.525008 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-755a4b89-568d-497c-afe5-a8e7712f2040 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:37.526550 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-755a4b89-568d-497c-afe5-a8e7712f2040 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:37.539492 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-755a4b89-568d-497c-afe5-a8e7712f2040 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:37.543969 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-755a4b89-568d-497c-afe5-a8e7712f2040 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:37.553889 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-755a4b89-568d-497c-afe5-a8e7712f2040 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:37.553889 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-755a4b89-568d-497c-afe5-a8e7712f2040 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:37.553889 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-755a4b89-568d-497c-afe5-a8e7712f2040 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:37.553889 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-755a4b89-568d-497c-afe5-a8e7712f2040 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:37.693860 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-463327a9-1b72-48e1-8f9d-9074ec364afa tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:37.703024 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-463327a9-1b72-48e1-8f9d-9074ec364afa tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d" status: 200 len: 1267 microversion: 2.1 time: 0.212627 Aug 26 00:56:37.705062 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 214/434] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:37 2022] GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d => generated 1267 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:37.754162 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-9a0cc55e-9b21-4643-9cf0-97c7bec5c72a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:37.755112 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-9a0cc55e-9b21-4643-9cf0-97c7bec5c72a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:37.769550 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9a0cc55e-9b21-4643-9cf0-97c7bec5c72a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:37.770353 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9a0cc55e-9b21-4643-9cf0-97c7bec5c72a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:37.771592 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9a0cc55e-9b21-4643-9cf0-97c7bec5c72a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:37.775004 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9a0cc55e-9b21-4643-9cf0-97c7bec5c72a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:37.775887 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9a0cc55e-9b21-4643-9cf0-97c7bec5c72a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:37.778073 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9a0cc55e-9b21-4643-9cf0-97c7bec5c72a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:37.808396 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-755a4b89-568d-497c-afe5-a8e7712f2040 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:37.825279 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-755a4b89-568d-497c-afe5-a8e7712f2040 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1721 microversion: 2.1 time: 0.302676 Aug 26 00:56:37.827656 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 221/435] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:37 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1721 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:37.901917 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-200b6fc9-1a88-4ec7-adf2-78459fc5db92 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:37.903003 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-200b6fc9-1a88-4ec7-adf2-78459fc5db92 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:37.910036 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-200b6fc9-1a88-4ec7-adf2-78459fc5db92 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:37.910841 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-200b6fc9-1a88-4ec7-adf2-78459fc5db92 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:37.911764 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-200b6fc9-1a88-4ec7-adf2-78459fc5db92 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:37.912063 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-200b6fc9-1a88-4ec7-adf2-78459fc5db92 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:37.912887 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-200b6fc9-1a88-4ec7-adf2-78459fc5db92 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:37.913326 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-200b6fc9-1a88-4ec7-adf2-78459fc5db92 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:37.986054 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-9a0cc55e-9b21-4643-9cf0-97c7bec5c72a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:38.001573 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-9a0cc55e-9b21-4643-9cf0-97c7bec5c72a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:38.003028 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-9a0cc55e-9b21-4643-9cf0-97c7bec5c72a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:38.004186 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-9a0cc55e-9b21-4643-9cf0-97c7bec5c72a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1739 microversion: 2.20 time: 0.259727 Aug 26 00:56:38.005119 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 215/436] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:56:37 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1739 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:56:38.277423 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-200b6fc9-1a88-4ec7-adf2-78459fc5db92 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:38.285833 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-200b6fc9-1a88-4ec7-adf2-78459fc5db92 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd" status: 200 len: 1372 microversion: 2.1 time: 0.388346 Aug 26 00:56:38.289946 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 222/437] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:37 2022] GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd => generated 1372 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:56:38.566085 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [req-a9d05001-fa90-4b9f-beb4-21b35b569234 req-6187b19d-1bf8-4506-bd88-ccf1fa039dd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd", "tag": "56f607c1-adc1-4120-ac0a-38b41904464e"}]} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:56:38.597122 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-a9d05001-fa90-4b9f-beb4-21b35b569234 req-6187b19d-1bf8-4506-bd88-ccf1fa039dd6 service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:38.597971 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-a9d05001-fa90-4b9f-beb4-21b35b569234 req-6187b19d-1bf8-4506-bd88-ccf1fa039dd6 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:38.599262 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-a9d05001-fa90-4b9f-beb4-21b35b569234 req-6187b19d-1bf8-4506-bd88-ccf1fa039dd6 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:38.621370 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.compute.server_external_events [req-a9d05001-fa90-4b9f-beb4-21b35b569234 req-6187b19d-1bf8-4506-bd88-ccf1fa039dd6 service nova] Creating event network-changed:56f607c1-adc1-4120-ac0a-38b41904464e for instance 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd on hv-cinder-83538 Aug 26 00:56:38.629750 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [req-a9d05001-fa90-4b9f-beb4-21b35b569234 req-6187b19d-1bf8-4506-bd88-ccf1fa039dd6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069864 Aug 26 00:56:38.632174 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 216/438] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 00:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:56:38.729480 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-900642e0-5824-4058-a399-848af3a4ecc9 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:38.730987 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-900642e0-5824-4058-a399-848af3a4ecc9 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: cc9ceee0-65b5-48be-8dcc-7ec2a992f72d] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:38.738241 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-900642e0-5824-4058-a399-848af3a4ecc9 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:38.739096 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-900642e0-5824-4058-a399-848af3a4ecc9 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:38.739761 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-900642e0-5824-4058-a399-848af3a4ecc9 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:38.741647 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-900642e0-5824-4058-a399-848af3a4ecc9 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:38.742340 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-900642e0-5824-4058-a399-848af3a4ecc9 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:38.743006 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-900642e0-5824-4058-a399-848af3a4ecc9 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:38.768202 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell1:SELECT=100 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:56:38.850679 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-52fdfc78-5773-488f-8c10-e48bb02046e8 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:38.851653 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-52fdfc78-5773-488f-8c10-e48bb02046e8 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:38.864856 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-52fdfc78-5773-488f-8c10-e48bb02046e8 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:38.865364 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-52fdfc78-5773-488f-8c10-e48bb02046e8 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:38.867379 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-52fdfc78-5773-488f-8c10-e48bb02046e8 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:38.870041 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-52fdfc78-5773-488f-8c10-e48bb02046e8 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:38.870630 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-52fdfc78-5773-488f-8c10-e48bb02046e8 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:38.871069 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-52fdfc78-5773-488f-8c10-e48bb02046e8 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:39.067215 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-52fdfc78-5773-488f-8c10-e48bb02046e8 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:39.080199 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-52fdfc78-5773-488f-8c10-e48bb02046e8 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1721 microversion: 2.1 time: 0.233232 Aug 26 00:56:39.081410 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 217/439] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:38 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1721 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:39.086959 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-e341d319-a0a3-433f-a40c-84416f7233fc tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:39.087687 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-e341d319-a0a3-433f-a40c-84416f7233fc tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:39.095749 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e341d319-a0a3-433f-a40c-84416f7233fc tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:39.096367 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e341d319-a0a3-433f-a40c-84416f7233fc tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:39.097006 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e341d319-a0a3-433f-a40c-84416f7233fc tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:39.104189 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e341d319-a0a3-433f-a40c-84416f7233fc tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:39.104189 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e341d319-a0a3-433f-a40c-84416f7233fc tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:39.104189 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e341d319-a0a3-433f-a40c-84416f7233fc tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:39.272439 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-e341d319-a0a3-433f-a40c-84416f7233fc tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:39.281377 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-e341d319-a0a3-433f-a40c-84416f7233fc tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:39.283752 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-e341d319-a0a3-433f-a40c-84416f7233fc tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:39.284973 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-e341d319-a0a3-433f-a40c-84416f7233fc tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1721 microversion: 2.20 time: 0.202353 Aug 26 00:56:39.285739 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 218/440] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:56:39 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1721 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:56:39.314765 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-72bab4e0-63fc-4922-9677-ce7555d1c53b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:39.315494 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-72bab4e0-63fc-4922-9677-ce7555d1c53b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:39.324100 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-72bab4e0-63fc-4922-9677-ce7555d1c53b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:39.324650 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-72bab4e0-63fc-4922-9677-ce7555d1c53b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:39.325443 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-72bab4e0-63fc-4922-9677-ce7555d1c53b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:39.325793 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-72bab4e0-63fc-4922-9677-ce7555d1c53b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:39.326384 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-72bab4e0-63fc-4922-9677-ce7555d1c53b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:39.326926 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-72bab4e0-63fc-4922-9677-ce7555d1c53b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:39.369091 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-900642e0-5824-4058-a399-848af3a4ecc9 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:39.377278 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-900642e0-5824-4058-a399-848af3a4ecc9 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d" status: 200 len: 1267 microversion: 2.1 time: 0.651674 Aug 26 00:56:39.378517 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 223/441] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:38 2022] GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d => generated 1267 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:39.490459 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-72bab4e0-63fc-4922-9677-ce7555d1c53b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:39.526518 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-72bab4e0-63fc-4922-9677-ce7555d1c53b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd" status: 200 len: 1372 microversion: 2.1 time: 0.214029 Aug 26 00:56:39.530816 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 219/442] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:39 2022] GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd => generated 1372 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:56:40.103546 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-702ab931-0cec-417e-9eb2-574e1a408bef tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:40.104247 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-702ab931-0cec-417e-9eb2-574e1a408bef tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:40.111341 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell0:SELECT=4 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:56:40.118758 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-702ab931-0cec-417e-9eb2-574e1a408bef tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:40.119254 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-702ab931-0cec-417e-9eb2-574e1a408bef tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:40.121510 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-702ab931-0cec-417e-9eb2-574e1a408bef tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:40.125364 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-702ab931-0cec-417e-9eb2-574e1a408bef tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:40.126096 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-702ab931-0cec-417e-9eb2-574e1a408bef tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:40.127472 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-702ab931-0cec-417e-9eb2-574e1a408bef tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:40.311008 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-fe1d74e6-8cb4-421e-b4f0-ec03ae4b593b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:40.312369 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-fe1d74e6-8cb4-421e-b4f0-ec03ae4b593b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:40.329731 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-fe1d74e6-8cb4-421e-b4f0-ec03ae4b593b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:40.330800 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-fe1d74e6-8cb4-421e-b4f0-ec03ae4b593b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:40.332561 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-fe1d74e6-8cb4-421e-b4f0-ec03ae4b593b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:40.333766 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-fe1d74e6-8cb4-421e-b4f0-ec03ae4b593b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:40.338090 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-fe1d74e6-8cb4-421e-b4f0-ec03ae4b593b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:40.338950 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-fe1d74e6-8cb4-421e-b4f0-ec03ae4b593b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:40.341529 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-702ab931-0cec-417e-9eb2-574e1a408bef tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:40.359382 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-702ab931-0cec-417e-9eb2-574e1a408bef tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1721 microversion: 2.1 time: 0.260901 Aug 26 00:56:40.361536 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 224/443] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:40 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1721 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:40.398860 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-0647c6f8-6f9d-481f-ad7c-3c45a918cdda tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:40.399743 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-0647c6f8-6f9d-481f-ad7c-3c45a918cdda tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: cc9ceee0-65b5-48be-8dcc-7ec2a992f72d] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:40.408143 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-0647c6f8-6f9d-481f-ad7c-3c45a918cdda tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:40.408919 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-0647c6f8-6f9d-481f-ad7c-3c45a918cdda tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:40.409532 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-0647c6f8-6f9d-481f-ad7c-3c45a918cdda tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:40.410404 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-0647c6f8-6f9d-481f-ad7c-3c45a918cdda tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:40.411014 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-0647c6f8-6f9d-481f-ad7c-3c45a918cdda tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:40.411712 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-0647c6f8-6f9d-481f-ad7c-3c45a918cdda tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:40.577681 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-fe1d74e6-8cb4-421e-b4f0-ec03ae4b593b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:40.588307 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-fe1d74e6-8cb4-421e-b4f0-ec03ae4b593b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:40.589797 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-fe1d74e6-8cb4-421e-b4f0-ec03ae4b593b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:40.593547 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-fe1d74e6-8cb4-421e-b4f0-ec03ae4b593b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1721 microversion: 2.20 time: 0.288264 Aug 26 00:56:40.595387 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 220/444] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:56:40 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1721 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:56:40.606026 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-0647c6f8-6f9d-481f-ad7c-3c45a918cdda tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:40.617701 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-0647c6f8-6f9d-481f-ad7c-3c45a918cdda tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d" status: 200 len: 1267 microversion: 2.1 time: 0.222643 Aug 26 00:56:40.617942 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-468d9b31-d693-4e06-a74a-60c78ca0f2c3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:40.628503 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-468d9b31-d693-4e06-a74a-60c78ca0f2c3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:40.628503 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-468d9b31-d693-4e06-a74a-60c78ca0f2c3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:40.628503 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-468d9b31-d693-4e06-a74a-60c78ca0f2c3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:40.628503 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-468d9b31-d693-4e06-a74a-60c78ca0f2c3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:40.630757 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 225/445] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:40 2022] GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d => generated 1267 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:40.635198 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-468d9b31-d693-4e06-a74a-60c78ca0f2c3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:40.635198 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-468d9b31-d693-4e06-a74a-60c78ca0f2c3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:40.635198 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-468d9b31-d693-4e06-a74a-60c78ca0f2c3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:40.956925 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-468d9b31-d693-4e06-a74a-60c78ca0f2c3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:40.981836 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-468d9b31-d693-4e06-a74a-60c78ca0f2c3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd" status: 200 len: 1372 microversion: 2.1 time: 0.382771 Aug 26 00:56:40.989017 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 221/446] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:40 2022] GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd => generated 1372 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:41.385670 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-5c811dc7-2aac-4995-9015-51e63570eb08 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:41.386423 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-5c811dc7-2aac-4995-9015-51e63570eb08 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:41.388241 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell0:SELECT=20 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:56:41.393246 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5c811dc7-2aac-4995-9015-51e63570eb08 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:41.393759 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5c811dc7-2aac-4995-9015-51e63570eb08 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:41.394269 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5c811dc7-2aac-4995-9015-51e63570eb08 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:41.394877 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5c811dc7-2aac-4995-9015-51e63570eb08 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:41.395324 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5c811dc7-2aac-4995-9015-51e63570eb08 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:41.395804 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5c811dc7-2aac-4995-9015-51e63570eb08 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:41.604025 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-5c811dc7-2aac-4995-9015-51e63570eb08 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:41.621636 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-33b4945a-13b2-4dfe-8466-e64273c0bb61 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:41.622210 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-5c811dc7-2aac-4995-9015-51e63570eb08 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1721 microversion: 2.1 time: 0.240262 Aug 26 00:56:41.622403 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-33b4945a-13b2-4dfe-8466-e64273c0bb61 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:41.622744 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 226/447] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:41 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1721 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:41.643636 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-33b4945a-13b2-4dfe-8466-e64273c0bb61 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:41.646786 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-9df0a43a-8dd0-445b-b54f-a6d0947ba276 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:41.648299 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-9df0a43a-8dd0-445b-b54f-a6d0947ba276 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: cc9ceee0-65b5-48be-8dcc-7ec2a992f72d] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:41.651401 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-33b4945a-13b2-4dfe-8466-e64273c0bb61 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:41.654720 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-33b4945a-13b2-4dfe-8466-e64273c0bb61 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:41.656662 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-33b4945a-13b2-4dfe-8466-e64273c0bb61 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:41.657698 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9df0a43a-8dd0-445b-b54f-a6d0947ba276 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:41.657904 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-33b4945a-13b2-4dfe-8466-e64273c0bb61 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:41.658347 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-33b4945a-13b2-4dfe-8466-e64273c0bb61 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:41.658780 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9df0a43a-8dd0-445b-b54f-a6d0947ba276 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:41.659379 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9df0a43a-8dd0-445b-b54f-a6d0947ba276 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:41.660259 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9df0a43a-8dd0-445b-b54f-a6d0947ba276 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:41.661537 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9df0a43a-8dd0-445b-b54f-a6d0947ba276 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:41.662125 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9df0a43a-8dd0-445b-b54f-a6d0947ba276 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:41.851615 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-9df0a43a-8dd0-445b-b54f-a6d0947ba276 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:41.862181 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-9df0a43a-8dd0-445b-b54f-a6d0947ba276 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d" status: 200 len: 1267 microversion: 2.1 time: 0.221640 Aug 26 00:56:41.863658 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 227/448] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:41 2022] GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d => generated 1267 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:42.003698 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-1f7fa3c5-31c5-44ab-9514-a7548e539a06 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:42.004413 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-1f7fa3c5-31c5-44ab-9514-a7548e539a06 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:42.010618 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1f7fa3c5-31c5-44ab-9514-a7548e539a06 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:42.021162 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1f7fa3c5-31c5-44ab-9514-a7548e539a06 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:42.021628 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1f7fa3c5-31c5-44ab-9514-a7548e539a06 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:42.022832 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1f7fa3c5-31c5-44ab-9514-a7548e539a06 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:42.023308 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1f7fa3c5-31c5-44ab-9514-a7548e539a06 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:42.023735 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1f7fa3c5-31c5-44ab-9514-a7548e539a06 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:42.171910 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-33b4945a-13b2-4dfe-8466-e64273c0bb61 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:42.175914 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell1:SELECT=100 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:56:42.183308 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-33b4945a-13b2-4dfe-8466-e64273c0bb61 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:42.184998 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-33b4945a-13b2-4dfe-8466-e64273c0bb61 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:42.186576 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-33b4945a-13b2-4dfe-8466-e64273c0bb61 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1724 microversion: 2.20 time: 0.570281 Aug 26 00:56:42.201453 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-1f7fa3c5-31c5-44ab-9514-a7548e539a06 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:42.202102 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 222/449] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:56:41 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1724 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 00:56:42.205654 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-1f7fa3c5-31c5-44ab-9514-a7548e539a06 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd" status: 200 len: 1372 microversion: 2.1 time: 0.205785 Aug 26 00:56:42.206847 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 228/450] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:41 2022] GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd => generated 1372 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:42.211481 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-14c8965e-687f-4687-9a5e-a8fb44e66f8e tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1eb8e79c-aa18-45e4-9491-8e4e0a406185"}} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:56:42.226189 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-14c8965e-687f-4687-9a5e-a8fb44e66f8e tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:42.228681 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-14c8965e-687f-4687-9a5e-a8fb44e66f8e tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:42.229426 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-14c8965e-687f-4687-9a5e-a8fb44e66f8e tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:42.229936 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-14c8965e-687f-4687-9a5e-a8fb44e66f8e tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:42.230781 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-14c8965e-687f-4687-9a5e-a8fb44e66f8e tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:42.231238 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-14c8965e-687f-4687-9a5e-a8fb44e66f8e tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:42.231667 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-14c8965e-687f-4687-9a5e-a8fb44e66f8e tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:42.648654 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-42ccc0ce-8c0e-4b7d-a2b6-e3a47775bf3c tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:42.650319 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-42ccc0ce-8c0e-4b7d-a2b6-e3a47775bf3c tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:42.659783 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-42ccc0ce-8c0e-4b7d-a2b6-e3a47775bf3c tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:42.661397 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-42ccc0ce-8c0e-4b7d-a2b6-e3a47775bf3c tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:42.661397 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-42ccc0ce-8c0e-4b7d-a2b6-e3a47775bf3c tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:42.662108 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-42ccc0ce-8c0e-4b7d-a2b6-e3a47775bf3c tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:42.663030 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-42ccc0ce-8c0e-4b7d-a2b6-e3a47775bf3c tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:42.663795 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-42ccc0ce-8c0e-4b7d-a2b6-e3a47775bf3c tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:42.832965 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-42ccc0ce-8c0e-4b7d-a2b6-e3a47775bf3c tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:42.845540 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-42ccc0ce-8c0e-4b7d-a2b6-e3a47775bf3c tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1721 microversion: 2.1 time: 0.205062 Aug 26 00:56:42.846614 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 229/451] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:42 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1721 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:56:42.883222 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-b57acb02-f268-4889-9295-6702c4c66e97 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:42.884119 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-b57acb02-f268-4889-9295-6702c4c66e97 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: cc9ceee0-65b5-48be-8dcc-7ec2a992f72d] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:42.892031 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b57acb02-f268-4889-9295-6702c4c66e97 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:42.892547 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b57acb02-f268-4889-9295-6702c4c66e97 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:42.892986 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b57acb02-f268-4889-9295-6702c4c66e97 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:42.893692 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b57acb02-f268-4889-9295-6702c4c66e97 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:42.894141 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b57acb02-f268-4889-9295-6702c4c66e97 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:42.894562 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b57acb02-f268-4889-9295-6702c4c66e97 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:43.081025 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-b57acb02-f268-4889-9295-6702c4c66e97 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:43.090050 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-b57acb02-f268-4889-9295-6702c4c66e97 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d" status: 200 len: 1267 microversion: 2.1 time: 0.210680 Aug 26 00:56:43.096103 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 230/452] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:42 2022] GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d => generated 1267 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:56:43.233571 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-c50aeebe-e961-482a-8378-409557bfdab5 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:43.234460 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-c50aeebe-e961-482a-8378-409557bfdab5 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:43.241823 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c50aeebe-e961-482a-8378-409557bfdab5 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:43.242320 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c50aeebe-e961-482a-8378-409557bfdab5 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:43.242768 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c50aeebe-e961-482a-8378-409557bfdab5 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:43.243476 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c50aeebe-e961-482a-8378-409557bfdab5 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:43.243929 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c50aeebe-e961-482a-8378-409557bfdab5 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:43.244565 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c50aeebe-e961-482a-8378-409557bfdab5 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:43.428373 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-c50aeebe-e961-482a-8378-409557bfdab5 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:43.447129 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-c50aeebe-e961-482a-8378-409557bfdab5 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd" status: 200 len: 1372 microversion: 2.1 time: 0.217429 Aug 26 00:56:43.449727 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 231/453] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:43 2022] GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd => generated 1372 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:56:43.464306 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-14c8965e-687f-4687-9a5e-a8fb44e66f8e tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "POST /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.257066 Aug 26 00:56:43.465960 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 223/454] 10.222.0.59 () {62 vars in 1364 bytes} [Fri Aug 26 00:56:42 2022] POST /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b/os-volume_attachments => generated 188 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 00:56:43.630228 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-1c295d12-5160-4140-97c4-6931afb40cd4 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:56:43.630744 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-1c295d12-5160-4140-97c4-6931afb40cd4 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:43.637838 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1c295d12-5160-4140-97c4-6931afb40cd4 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:43.638344 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1c295d12-5160-4140-97c4-6931afb40cd4 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:43.639176 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1c295d12-5160-4140-97c4-6931afb40cd4 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:43.640265 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1c295d12-5160-4140-97c4-6931afb40cd4 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:43.640753 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1c295d12-5160-4140-97c4-6931afb40cd4 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:43.641206 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1c295d12-5160-4140-97c4-6931afb40cd4 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:43.690804 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-1c295d12-5160-4140-97c4-6931afb40cd4 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127564) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 26 00:56:43.871709 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-dbcb25ab-452e-4bab-81c7-654e8b6e0144 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:43.872310 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-dbcb25ab-452e-4bab-81c7-654e8b6e0144 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:43.879478 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-dbcb25ab-452e-4bab-81c7-654e8b6e0144 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:43.879951 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-dbcb25ab-452e-4bab-81c7-654e8b6e0144 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:43.880388 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-dbcb25ab-452e-4bab-81c7-654e8b6e0144 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:43.881108 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-dbcb25ab-452e-4bab-81c7-654e8b6e0144 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:43.881555 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-dbcb25ab-452e-4bab-81c7-654e8b6e0144 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:43.881983 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-dbcb25ab-452e-4bab-81c7-654e8b6e0144 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:44.039017 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-dbcb25ab-452e-4bab-81c7-654e8b6e0144 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:44.044231 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-1c295d12-5160-4140-97c4-6931afb40cd4 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "POST /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b/action" status: 202 len: 0 microversion: 2.20 time: 0.418735 Aug 26 00:56:44.048195 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 232/455] 10.222.0.59 () {62 vars in 1319 bytes} [Fri Aug 26 00:56:43 2022] POST /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b/action => generated 0 bytes in 423 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 26 00:56:44.053371 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-0fe31e63-4a5a-4e06-b442-1744538b73a9 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:44.054339 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-0fe31e63-4a5a-4e06-b442-1744538b73a9 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:44.058149 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-dbcb25ab-452e-4bab-81c7-654e8b6e0144 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1721 microversion: 2.1 time: 0.193310 Aug 26 00:56:44.062813 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-0fe31e63-4a5a-4e06-b442-1744538b73a9 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:44.063619 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-0fe31e63-4a5a-4e06-b442-1744538b73a9 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:44.064057 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 224/456] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:43 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1721 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:56:44.064389 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-0fe31e63-4a5a-4e06-b442-1744538b73a9 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:44.065361 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-0fe31e63-4a5a-4e06-b442-1744538b73a9 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:44.065820 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-0fe31e63-4a5a-4e06-b442-1744538b73a9 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:44.066410 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-0fe31e63-4a5a-4e06-b442-1744538b73a9 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:44.120916 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-75637db1-39ce-4f70-8f91-2a5a58c77341 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:44.121911 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-75637db1-39ce-4f70-8f91-2a5a58c77341 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: cc9ceee0-65b5-48be-8dcc-7ec2a992f72d] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:44.123585 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:56:44.133676 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-75637db1-39ce-4f70-8f91-2a5a58c77341 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:44.137086 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-75637db1-39ce-4f70-8f91-2a5a58c77341 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:44.137547 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-75637db1-39ce-4f70-8f91-2a5a58c77341 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:44.138670 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-75637db1-39ce-4f70-8f91-2a5a58c77341 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:44.139138 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-75637db1-39ce-4f70-8f91-2a5a58c77341 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:44.139589 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-75637db1-39ce-4f70-8f91-2a5a58c77341 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:44.324223 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-0fe31e63-4a5a-4e06-b442-1744538b73a9 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:44.350173 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-0fe31e63-4a5a-4e06-b442-1744538b73a9 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:44.355691 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-75637db1-39ce-4f70-8f91-2a5a58c77341 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:44.357675 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-0fe31e63-4a5a-4e06-b442-1744538b73a9 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:44.359099 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-0fe31e63-4a5a-4e06-b442-1744538b73a9 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1810 microversion: 2.20 time: 0.309731 Aug 26 00:56:44.359652 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 233/457] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:56:44 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1810 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:56:44.365084 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-75637db1-39ce-4f70-8f91-2a5a58c77341 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d" status: 200 len: 1267 microversion: 2.1 time: 0.249772 Aug 26 00:56:44.380122 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 225/458] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:44 2022] GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d => generated 1267 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:56:44.472995 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-b756402d-f0b1-471e-b950-e6413ff62875 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:44.474182 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-b756402d-f0b1-471e-b950-e6413ff62875 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:44.484370 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b756402d-f0b1-471e-b950-e6413ff62875 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:44.486357 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b756402d-f0b1-471e-b950-e6413ff62875 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:44.486800 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b756402d-f0b1-471e-b950-e6413ff62875 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:44.488847 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b756402d-f0b1-471e-b950-e6413ff62875 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:44.489314 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b756402d-f0b1-471e-b950-e6413ff62875 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:44.489738 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b756402d-f0b1-471e-b950-e6413ff62875 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:44.683396 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-b756402d-f0b1-471e-b950-e6413ff62875 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:44.697270 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-b756402d-f0b1-471e-b950-e6413ff62875 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd" status: 200 len: 1372 microversion: 2.1 time: 0.230540 Aug 26 00:56:44.712656 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 234/459] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:44 2022] GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd => generated 1372 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:56:44.838330 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [req-0097422c-ade2-4ad5-b17b-1a5f4e1a4a6b req-01a6c652-0228-4683-877b-fbf9e2357ba5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7502d0cf-4abc-484b-8c85-d8ea6682333b", "name": "network-vif-unplugged", "status": "completed", "tag": "ee6ad2fb-f57e-474d-a46b-a0d19ae36479"}]} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:56:44.853084 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-0097422c-ade2-4ad5-b17b-1a5f4e1a4a6b req-01a6c652-0228-4683-877b-fbf9e2357ba5 service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:44.853820 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-0097422c-ade2-4ad5-b17b-1a5f4e1a4a6b req-01a6c652-0228-4683-877b-fbf9e2357ba5 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:44.854563 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-0097422c-ade2-4ad5-b17b-1a5f4e1a4a6b req-01a6c652-0228-4683-877b-fbf9e2357ba5 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:44.870748 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.compute.server_external_events [req-0097422c-ade2-4ad5-b17b-1a5f4e1a4a6b req-01a6c652-0228-4683-877b-fbf9e2357ba5 service nova] Creating event network-vif-unplugged:ee6ad2fb-f57e-474d-a46b-a0d19ae36479 for instance 7502d0cf-4abc-484b-8c85-d8ea6682333b on hv-cinder-83538 Aug 26 00:56:44.877404 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [req-0097422c-ade2-4ad5-b17b-1a5f4e1a4a6b req-01a6c652-0228-4683-877b-fbf9e2357ba5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043182 Aug 26 00:56:44.878859 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 226/460] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 00:56:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:56:45.088518 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-696e197f-7687-4c98-90b6-dc1c714bf9c4 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:45.089434 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-696e197f-7687-4c98-90b6-dc1c714bf9c4 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:45.096374 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-696e197f-7687-4c98-90b6-dc1c714bf9c4 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:45.097085 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-696e197f-7687-4c98-90b6-dc1c714bf9c4 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:45.097677 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-696e197f-7687-4c98-90b6-dc1c714bf9c4 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:45.098540 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-696e197f-7687-4c98-90b6-dc1c714bf9c4 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:45.104997 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-696e197f-7687-4c98-90b6-dc1c714bf9c4 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:45.105660 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-696e197f-7687-4c98-90b6-dc1c714bf9c4 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:45.335214 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-696e197f-7687-4c98-90b6-dc1c714bf9c4 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:45.347430 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-696e197f-7687-4c98-90b6-dc1c714bf9c4 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1721 microversion: 2.1 time: 0.263603 Aug 26 00:56:45.348009 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 235/461] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:45 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1721 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:45.396549 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-558123b2-27cd-4006-92b7-4efa84a26c7b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:45.396921 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-ceeaebee-29bc-4ab2-b9f5-85e29c65b584 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:45.397921 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-ceeaebee-29bc-4ab2-b9f5-85e29c65b584 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: cc9ceee0-65b5-48be-8dcc-7ec2a992f72d] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:45.398643 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-558123b2-27cd-4006-92b7-4efa84a26c7b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:45.424848 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-558123b2-27cd-4006-92b7-4efa84a26c7b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:45.425198 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-558123b2-27cd-4006-92b7-4efa84a26c7b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:45.425637 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-558123b2-27cd-4006-92b7-4efa84a26c7b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:45.426556 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-558123b2-27cd-4006-92b7-4efa84a26c7b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:45.427295 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-558123b2-27cd-4006-92b7-4efa84a26c7b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:45.427729 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-558123b2-27cd-4006-92b7-4efa84a26c7b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:45.429641 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ceeaebee-29bc-4ab2-b9f5-85e29c65b584 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:45.433831 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ceeaebee-29bc-4ab2-b9f5-85e29c65b584 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:45.433831 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ceeaebee-29bc-4ab2-b9f5-85e29c65b584 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:45.433831 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ceeaebee-29bc-4ab2-b9f5-85e29c65b584 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:45.434115 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ceeaebee-29bc-4ab2-b9f5-85e29c65b584 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:45.434796 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ceeaebee-29bc-4ab2-b9f5-85e29c65b584 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:45.656702 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-ceeaebee-29bc-4ab2-b9f5-85e29c65b584 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:45.667193 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-ceeaebee-29bc-4ab2-b9f5-85e29c65b584 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d" status: 200 len: 1267 microversion: 2.1 time: 0.281580 Aug 26 00:56:45.683111 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 227/462] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:45 2022] GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d => generated 1267 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:45.720311 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-605c804c-d14f-45b2-bd06-22a801eba6a1 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:45.720956 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-605c804c-d14f-45b2-bd06-22a801eba6a1 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:45.731937 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-605c804c-d14f-45b2-bd06-22a801eba6a1 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:45.732434 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-605c804c-d14f-45b2-bd06-22a801eba6a1 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:45.732888 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-605c804c-d14f-45b2-bd06-22a801eba6a1 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:45.737051 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-605c804c-d14f-45b2-bd06-22a801eba6a1 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:45.737858 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-605c804c-d14f-45b2-bd06-22a801eba6a1 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:45.738460 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-605c804c-d14f-45b2-bd06-22a801eba6a1 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:45.786463 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-558123b2-27cd-4006-92b7-4efa84a26c7b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:45.796301 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-558123b2-27cd-4006-92b7-4efa84a26c7b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:45.798188 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-558123b2-27cd-4006-92b7-4efa84a26c7b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:45.801877 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-558123b2-27cd-4006-92b7-4efa84a26c7b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1810 microversion: 2.20 time: 0.418216 Aug 26 00:56:45.802494 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 236/463] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:56:45 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1810 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:56:45.924795 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-605c804c-d14f-45b2-bd06-22a801eba6a1 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:45.938097 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-605c804c-d14f-45b2-bd06-22a801eba6a1 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd" status: 200 len: 1372 microversion: 2.1 time: 0.222767 Aug 26 00:56:45.939317 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 228/464] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:45 2022] GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd => generated 1372 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:56:46.370979 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-4b507a91-7196-4878-b39d-711f98373e61 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:46.371858 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-4b507a91-7196-4878-b39d-711f98373e61 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:46.380699 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-4b507a91-7196-4878-b39d-711f98373e61 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:46.381423 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-4b507a91-7196-4878-b39d-711f98373e61 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:46.382059 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-4b507a91-7196-4878-b39d-711f98373e61 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:46.383048 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-4b507a91-7196-4878-b39d-711f98373e61 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:46.394753 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-4b507a91-7196-4878-b39d-711f98373e61 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:46.398859 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-4b507a91-7196-4878-b39d-711f98373e61 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:46.677988 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-4b507a91-7196-4878-b39d-711f98373e61 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:46.689461 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-161232dc-df0b-4899-be1e-438af0107975 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:46.690068 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-161232dc-df0b-4899-be1e-438af0107975 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: cc9ceee0-65b5-48be-8dcc-7ec2a992f72d] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:46.694236 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-4b507a91-7196-4878-b39d-711f98373e61 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1698 microversion: 2.1 time: 0.327175 Aug 26 00:56:46.695395 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 237/465] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:46 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1698 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:46.709117 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-161232dc-df0b-4899-be1e-438af0107975 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:46.713750 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-161232dc-df0b-4899-be1e-438af0107975 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:46.714432 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-161232dc-df0b-4899-be1e-438af0107975 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:46.715382 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-161232dc-df0b-4899-be1e-438af0107975 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:46.718474 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-161232dc-df0b-4899-be1e-438af0107975 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:46.719102 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-161232dc-df0b-4899-be1e-438af0107975 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:46.723025 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-4d2d1c9e-2111-4fec-9560-75fa09a5d51f tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:56:46.729523 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-4d2d1c9e-2111-4fec-9560-75fa09a5d51f tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:46.730234 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-4d2d1c9e-2111-4fec-9560-75fa09a5d51f tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:46.731367 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-4d2d1c9e-2111-4fec-9560-75fa09a5d51f tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:46.857335 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-4d2d1c9e-2111-4fec-9560-75fa09a5d51f tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Going to try to start instance {{(pid=127564) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 26 00:56:46.918654 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:56:47.051930 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-161232dc-df0b-4899-be1e-438af0107975 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:47.069108 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-161232dc-df0b-4899-be1e-438af0107975 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d" status: 200 len: 1267 microversion: 2.1 time: 0.382353 Aug 26 00:56:47.069734 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 229/466] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:46 2022] GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d => generated 1267 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:56:47.080697 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-13a1b885-554f-40ac-aba2-779de2c8fdff tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:47.081324 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-13a1b885-554f-40ac-aba2-779de2c8fdff tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:47.089176 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-13a1b885-554f-40ac-aba2-779de2c8fdff tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:47.091284 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-13a1b885-554f-40ac-aba2-779de2c8fdff tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:47.091284 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-13a1b885-554f-40ac-aba2-779de2c8fdff tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:47.091284 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-13a1b885-554f-40ac-aba2-779de2c8fdff tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:47.092178 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-13a1b885-554f-40ac-aba2-779de2c8fdff tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:47.092855 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-13a1b885-554f-40ac-aba2-779de2c8fdff tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:47.154795 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-4d2d1c9e-2111-4fec-9560-75fa09a5d51f tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "POST /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7/action" status: 202 len: 0 microversion: 2.1 time: 0.435930 Aug 26 00:56:47.158710 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 238/467] 10.222.0.59 () {60 vars in 1278 bytes} [Fri Aug 26 00:56:46 2022] POST /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7/action => generated 0 bytes in 438 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 00:56:47.177922 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-25721a17-825f-451e-a077-dfe102f1bfb7 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:47.181132 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-25721a17-825f-451e-a077-dfe102f1bfb7 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:47.200313 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-25721a17-825f-451e-a077-dfe102f1bfb7 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:47.201230 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-25721a17-825f-451e-a077-dfe102f1bfb7 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:47.202210 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-25721a17-825f-451e-a077-dfe102f1bfb7 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:47.203558 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-25721a17-825f-451e-a077-dfe102f1bfb7 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:47.204947 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-25721a17-825f-451e-a077-dfe102f1bfb7 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:47.205813 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-25721a17-825f-451e-a077-dfe102f1bfb7 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:47.496750 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-13a1b885-554f-40ac-aba2-779de2c8fdff tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:47.525475 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-13a1b885-554f-40ac-aba2-779de2c8fdff tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:47.527062 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-13a1b885-554f-40ac-aba2-779de2c8fdff tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:47.529634 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-13a1b885-554f-40ac-aba2-779de2c8fdff tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1810 microversion: 2.20 time: 0.458926 Aug 26 00:56:47.530206 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 230/468] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:56:47 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1810 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:56:47.536187 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-d7c1d0d8-c140-4427-b9a2-b3f6ad417a12 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:47.537070 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-d7c1d0d8-c140-4427-b9a2-b3f6ad417a12 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:47.544230 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d7c1d0d8-c140-4427-b9a2-b3f6ad417a12 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:47.553663 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d7c1d0d8-c140-4427-b9a2-b3f6ad417a12 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:47.554665 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d7c1d0d8-c140-4427-b9a2-b3f6ad417a12 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:47.558070 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d7c1d0d8-c140-4427-b9a2-b3f6ad417a12 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:47.559583 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d7c1d0d8-c140-4427-b9a2-b3f6ad417a12 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:47.561694 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d7c1d0d8-c140-4427-b9a2-b3f6ad417a12 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:47.666334 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-25721a17-825f-451e-a077-dfe102f1bfb7 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:47.679971 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-25721a17-825f-451e-a077-dfe102f1bfb7 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd" status: 200 len: 1372 microversion: 2.1 time: 0.512825 Aug 26 00:56:47.683988 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 239/469] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:47 2022] GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd => generated 1372 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:47.862312 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-d7c1d0d8-c140-4427-b9a2-b3f6ad417a12 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:47.873908 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-d7c1d0d8-c140-4427-b9a2-b3f6ad417a12 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1707 microversion: 2.1 time: 0.340640 Aug 26 00:56:47.875096 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 231/470] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:47 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1707 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:48.089381 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-6c793848-a676-4296-82e9-f3c5fe17d7d7 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:48.090868 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-6c793848-a676-4296-82e9-f3c5fe17d7d7 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: cc9ceee0-65b5-48be-8dcc-7ec2a992f72d] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:48.107957 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6c793848-a676-4296-82e9-f3c5fe17d7d7 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:48.108578 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6c793848-a676-4296-82e9-f3c5fe17d7d7 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:48.110924 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6c793848-a676-4296-82e9-f3c5fe17d7d7 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:48.111813 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6c793848-a676-4296-82e9-f3c5fe17d7d7 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:48.114213 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6c793848-a676-4296-82e9-f3c5fe17d7d7 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:48.125151 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6c793848-a676-4296-82e9-f3c5fe17d7d7 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:48.444654 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-6c793848-a676-4296-82e9-f3c5fe17d7d7 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:48.472349 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-6c793848-a676-4296-82e9-f3c5fe17d7d7 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d" status: 200 len: 1267 microversion: 2.1 time: 0.387259 Aug 26 00:56:48.490803 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 240/471] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:48 2022] GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d => generated 1267 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:48.559057 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-5f3ca07c-ba2f-40c4-9c98-787d63c1c735 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:48.559694 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-5f3ca07c-ba2f-40c4-9c98-787d63c1c735 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:48.566787 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5f3ca07c-ba2f-40c4-9c98-787d63c1c735 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:48.567322 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5f3ca07c-ba2f-40c4-9c98-787d63c1c735 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:48.567712 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5f3ca07c-ba2f-40c4-9c98-787d63c1c735 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:48.568409 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5f3ca07c-ba2f-40c4-9c98-787d63c1c735 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:48.569134 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5f3ca07c-ba2f-40c4-9c98-787d63c1c735 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:48.569676 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5f3ca07c-ba2f-40c4-9c98-787d63c1c735 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:48.708881 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-3a1a1320-78b5-4071-b626-d61196644cbe tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:48.709831 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-3a1a1320-78b5-4071-b626-d61196644cbe tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:48.743511 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3a1a1320-78b5-4071-b626-d61196644cbe tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:48.744338 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3a1a1320-78b5-4071-b626-d61196644cbe tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:48.745023 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3a1a1320-78b5-4071-b626-d61196644cbe tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:48.746017 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3a1a1320-78b5-4071-b626-d61196644cbe tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:48.746674 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3a1a1320-78b5-4071-b626-d61196644cbe tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:48.747286 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3a1a1320-78b5-4071-b626-d61196644cbe tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:48.786494 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-5f3ca07c-ba2f-40c4-9c98-787d63c1c735 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:48.795859 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-5f3ca07c-ba2f-40c4-9c98-787d63c1c735 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:48.797361 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-5f3ca07c-ba2f-40c4-9c98-787d63c1c735 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:48.799330 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-5f3ca07c-ba2f-40c4-9c98-787d63c1c735 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1752 microversion: 2.20 time: 0.244206 Aug 26 00:56:48.804582 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 232/472] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:56:48 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1752 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:56:48.887455 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-3a1a1320-78b5-4071-b626-d61196644cbe tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:48.895372 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-3a1a1320-78b5-4071-b626-d61196644cbe tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd" status: 200 len: 1372 microversion: 2.1 time: 0.190785 Aug 26 00:56:48.895943 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 241/473] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:48 2022] GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd => generated 1372 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:56:48.898015 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-40ceffc1-d0c1-4865-85fc-7de82f47f19c tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:48.898620 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-40ceffc1-d0c1-4865-85fc-7de82f47f19c tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:48.904705 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-40ceffc1-d0c1-4865-85fc-7de82f47f19c tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:48.905190 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-40ceffc1-d0c1-4865-85fc-7de82f47f19c tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:48.905595 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-40ceffc1-d0c1-4865-85fc-7de82f47f19c tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:48.906267 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-40ceffc1-d0c1-4865-85fc-7de82f47f19c tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:48.906708 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-40ceffc1-d0c1-4865-85fc-7de82f47f19c tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:48.908002 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-40ceffc1-d0c1-4865-85fc-7de82f47f19c tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:49.148103 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-40ceffc1-d0c1-4865-85fc-7de82f47f19c tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:49.163020 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-40ceffc1-d0c1-4865-85fc-7de82f47f19c tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1707 microversion: 2.1 time: 0.268672 Aug 26 00:56:49.163612 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 233/474] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:48 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1707 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:56:49.456212 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [req-fb32d8c2-e3b0-401a-98b1-8b7b202b7d7b req-5c2ce58b-c0bd-4936-9955-b6f0a523251f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc9ceee0-65b5-48be-8dcc-7ec2a992f72d", "name": "network-vif-plugged", "status": "completed", "tag": "6f818c22-5eed-4378-90e3-cf3becc67582"}]} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:56:49.473389 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-fb32d8c2-e3b0-401a-98b1-8b7b202b7d7b req-5c2ce58b-c0bd-4936-9955-b6f0a523251f service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:49.477943 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-fb32d8c2-e3b0-401a-98b1-8b7b202b7d7b req-5c2ce58b-c0bd-4936-9955-b6f0a523251f service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:49.477943 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-fb32d8c2-e3b0-401a-98b1-8b7b202b7d7b req-5c2ce58b-c0bd-4936-9955-b6f0a523251f service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:49.487545 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.compute.server_external_events [req-fb32d8c2-e3b0-401a-98b1-8b7b202b7d7b req-5c2ce58b-c0bd-4936-9955-b6f0a523251f service nova] Creating event network-vif-plugged:6f818c22-5eed-4378-90e3-cf3becc67582 for instance cc9ceee0-65b5-48be-8dcc-7ec2a992f72d on hv-cinder-83538 Aug 26 00:56:49.494195 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [req-fb32d8c2-e3b0-401a-98b1-8b7b202b7d7b req-5c2ce58b-c0bd-4936-9955-b6f0a523251f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043633 Aug 26 00:56:49.495314 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 242/475] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 00:56:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:56:49.499591 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-79facd20-15a1-4e98-a2d6-f0e5cc8c9438 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:49.501247 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-79facd20-15a1-4e98-a2d6-f0e5cc8c9438 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: cc9ceee0-65b5-48be-8dcc-7ec2a992f72d] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:49.509964 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-79facd20-15a1-4e98-a2d6-f0e5cc8c9438 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:49.510355 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-79facd20-15a1-4e98-a2d6-f0e5cc8c9438 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:49.510970 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-79facd20-15a1-4e98-a2d6-f0e5cc8c9438 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:49.511823 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-79facd20-15a1-4e98-a2d6-f0e5cc8c9438 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:49.512992 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-79facd20-15a1-4e98-a2d6-f0e5cc8c9438 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:49.513582 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-79facd20-15a1-4e98-a2d6-f0e5cc8c9438 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:49.751667 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-79facd20-15a1-4e98-a2d6-f0e5cc8c9438 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:49.761823 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-79facd20-15a1-4e98-a2d6-f0e5cc8c9438 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d" status: 200 len: 1267 microversion: 2.1 time: 0.268239 Aug 26 00:56:49.766403 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 234/476] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:49 2022] GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d => generated 1267 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:49.823868 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-01dc1300-1f72-4c6c-b722-d2f2fe062646 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:49.824584 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-01dc1300-1f72-4c6c-b722-d2f2fe062646 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:49.833158 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-01dc1300-1f72-4c6c-b722-d2f2fe062646 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:49.833933 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-01dc1300-1f72-4c6c-b722-d2f2fe062646 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:49.834541 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-01dc1300-1f72-4c6c-b722-d2f2fe062646 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:49.835529 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-01dc1300-1f72-4c6c-b722-d2f2fe062646 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:49.836457 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-01dc1300-1f72-4c6c-b722-d2f2fe062646 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:49.837114 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-01dc1300-1f72-4c6c-b722-d2f2fe062646 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:49.918863 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-3970e588-06bf-4b22-ba7b-16aa845f55a1 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:49.919853 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-3970e588-06bf-4b22-ba7b-16aa845f55a1 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:49.929739 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3970e588-06bf-4b22-ba7b-16aa845f55a1 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:49.934065 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3970e588-06bf-4b22-ba7b-16aa845f55a1 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:49.934691 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3970e588-06bf-4b22-ba7b-16aa845f55a1 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:49.935580 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3970e588-06bf-4b22-ba7b-16aa845f55a1 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:49.936247 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3970e588-06bf-4b22-ba7b-16aa845f55a1 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:49.936821 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3970e588-06bf-4b22-ba7b-16aa845f55a1 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:50.063197 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-01dc1300-1f72-4c6c-b722-d2f2fe062646 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:50.074007 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-01dc1300-1f72-4c6c-b722-d2f2fe062646 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:50.075547 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-01dc1300-1f72-4c6c-b722-d2f2fe062646 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:50.077343 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-01dc1300-1f72-4c6c-b722-d2f2fe062646 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1752 microversion: 2.20 time: 0.257703 Aug 26 00:56:50.086831 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 243/477] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:56:49 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1752 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:56:50.186298 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-1ef9d00c-d684-4ff3-b11b-afdce19156dd tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:50.186934 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-1ef9d00c-d684-4ff3-b11b-afdce19156dd tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:50.194877 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1ef9d00c-d684-4ff3-b11b-afdce19156dd tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:50.201369 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1ef9d00c-d684-4ff3-b11b-afdce19156dd tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:50.201369 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1ef9d00c-d684-4ff3-b11b-afdce19156dd tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:50.201369 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1ef9d00c-d684-4ff3-b11b-afdce19156dd tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:50.201369 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1ef9d00c-d684-4ff3-b11b-afdce19156dd tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:50.201740 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1ef9d00c-d684-4ff3-b11b-afdce19156dd tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:50.233593 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-3970e588-06bf-4b22-ba7b-16aa845f55a1 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:50.252715 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-3970e588-06bf-4b22-ba7b-16aa845f55a1 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd" status: 200 len: 1372 microversion: 2.1 time: 0.339068 Aug 26 00:56:50.266559 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 235/478] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:49 2022] GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd => generated 1372 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:56:50.417891 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-1ef9d00c-d684-4ff3-b11b-afdce19156dd tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:50.427651 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-1ef9d00c-d684-4ff3-b11b-afdce19156dd tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1711 microversion: 2.1 time: 0.245225 Aug 26 00:56:50.454516 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 244/479] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:50 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1711 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:56:50.785839 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-5e2bba76-8a36-43d3-b0ae-e4ed63812bf6 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:50.786648 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-5e2bba76-8a36-43d3-b0ae-e4ed63812bf6 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: cc9ceee0-65b5-48be-8dcc-7ec2a992f72d] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:50.798230 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5e2bba76-8a36-43d3-b0ae-e4ed63812bf6 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:50.801127 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5e2bba76-8a36-43d3-b0ae-e4ed63812bf6 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:50.801127 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5e2bba76-8a36-43d3-b0ae-e4ed63812bf6 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:50.801127 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5e2bba76-8a36-43d3-b0ae-e4ed63812bf6 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:50.801127 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5e2bba76-8a36-43d3-b0ae-e4ed63812bf6 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:50.801493 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5e2bba76-8a36-43d3-b0ae-e4ed63812bf6 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:50.952869 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-5e2bba76-8a36-43d3-b0ae-e4ed63812bf6 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:50.961155 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-5e2bba76-8a36-43d3-b0ae-e4ed63812bf6 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d" status: 200 len: 1267 microversion: 2.1 time: 0.181237 Aug 26 00:56:50.962163 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 236/480] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:50 2022] GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d => generated 1267 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:51.104432 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-28668c14-1046-4cf6-ac57-3bde4b5ef6d5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:51.105934 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-28668c14-1046-4cf6-ac57-3bde4b5ef6d5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:51.116052 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-28668c14-1046-4cf6-ac57-3bde4b5ef6d5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:51.116593 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-28668c14-1046-4cf6-ac57-3bde4b5ef6d5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:51.120142 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-28668c14-1046-4cf6-ac57-3bde4b5ef6d5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:51.121627 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-28668c14-1046-4cf6-ac57-3bde4b5ef6d5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:51.123527 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-28668c14-1046-4cf6-ac57-3bde4b5ef6d5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:51.124572 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-28668c14-1046-4cf6-ac57-3bde4b5ef6d5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:51.275628 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-ec61aecc-6e49-4d44-829e-fbbd74ff3e4d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:51.276272 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-ec61aecc-6e49-4d44-829e-fbbd74ff3e4d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:51.287298 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ec61aecc-6e49-4d44-829e-fbbd74ff3e4d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:51.288049 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ec61aecc-6e49-4d44-829e-fbbd74ff3e4d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:51.290155 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ec61aecc-6e49-4d44-829e-fbbd74ff3e4d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:51.290155 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ec61aecc-6e49-4d44-829e-fbbd74ff3e4d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:51.290155 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ec61aecc-6e49-4d44-829e-fbbd74ff3e4d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:51.290454 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ec61aecc-6e49-4d44-829e-fbbd74ff3e4d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:51.331975 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:56:51.376641 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-28668c14-1046-4cf6-ac57-3bde4b5ef6d5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:51.386464 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-28668c14-1046-4cf6-ac57-3bde4b5ef6d5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:51.387935 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-28668c14-1046-4cf6-ac57-3bde4b5ef6d5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:51.389942 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-28668c14-1046-4cf6-ac57-3bde4b5ef6d5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1752 microversion: 2.20 time: 0.290686 Aug 26 00:56:51.391081 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 245/481] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:56:51 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1752 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:56:51.519925 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [req-bf113465-c390-4a1b-86ad-e6d12fb1d839 req-3c8004f0-dd27-45ad-98f7-9883a31e9af1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd", "name": "network-vif-plugged", "status": "completed", "tag": "56f607c1-adc1-4120-ac0a-38b41904464e"}]} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:56:51.545620 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-bf113465-c390-4a1b-86ad-e6d12fb1d839 req-3c8004f0-dd27-45ad-98f7-9883a31e9af1 service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:51.546118 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-bf113465-c390-4a1b-86ad-e6d12fb1d839 req-3c8004f0-dd27-45ad-98f7-9883a31e9af1 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:51.548465 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-bf113465-c390-4a1b-86ad-e6d12fb1d839 req-3c8004f0-dd27-45ad-98f7-9883a31e9af1 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:51.555398 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-ec61aecc-6e49-4d44-829e-fbbd74ff3e4d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:51.565178 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-ec61aecc-6e49-4d44-829e-fbbd74ff3e4d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd" status: 200 len: 1372 microversion: 2.1 time: 0.294051 Aug 26 00:56:51.569173 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 237/482] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:51 2022] GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd => generated 1372 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:56:51.576584 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.compute.server_external_events [req-bf113465-c390-4a1b-86ad-e6d12fb1d839 req-3c8004f0-dd27-45ad-98f7-9883a31e9af1 service nova] Creating event network-vif-plugged:56f607c1-adc1-4120-ac0a-38b41904464e for instance 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd on hv-cinder-83538 Aug 26 00:56:51.582063 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [req-bf113465-c390-4a1b-86ad-e6d12fb1d839 req-3c8004f0-dd27-45ad-98f7-9883a31e9af1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066906 Aug 26 00:56:51.582893 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 246/483] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 00:56:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:56:51.984429 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-d494be95-82c7-4105-9001-e5eba67edb8c tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:51.987200 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-d494be95-82c7-4105-9001-e5eba67edb8c tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: cc9ceee0-65b5-48be-8dcc-7ec2a992f72d] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:52.010046 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d494be95-82c7-4105-9001-e5eba67edb8c tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:52.011506 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d494be95-82c7-4105-9001-e5eba67edb8c tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:52.013241 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d494be95-82c7-4105-9001-e5eba67edb8c tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:52.014355 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d494be95-82c7-4105-9001-e5eba67edb8c tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:52.014897 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d494be95-82c7-4105-9001-e5eba67edb8c tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:52.015501 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d494be95-82c7-4105-9001-e5eba67edb8c tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:52.220447 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-d494be95-82c7-4105-9001-e5eba67edb8c tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:52.228881 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-d494be95-82c7-4105-9001-e5eba67edb8c tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d" status: 200 len: 1267 microversion: 2.1 time: 0.250480 Aug 26 00:56:52.229459 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 238/484] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:51 2022] GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d => generated 1267 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:52.418262 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-2c18af2b-3cf3-41c4-87ee-975243884fcb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:52.418879 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-2c18af2b-3cf3-41c4-87ee-975243884fcb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:52.425104 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2c18af2b-3cf3-41c4-87ee-975243884fcb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:52.425583 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2c18af2b-3cf3-41c4-87ee-975243884fcb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:52.426013 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2c18af2b-3cf3-41c4-87ee-975243884fcb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:52.426693 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2c18af2b-3cf3-41c4-87ee-975243884fcb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:52.427142 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2c18af2b-3cf3-41c4-87ee-975243884fcb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:52.427561 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2c18af2b-3cf3-41c4-87ee-975243884fcb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:52.587855 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-93950192-d005-41c8-842a-00815dc1047c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:52.589067 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-93950192-d005-41c8-842a-00815dc1047c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:52.595785 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-2c18af2b-3cf3-41c4-87ee-975243884fcb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:52.597487 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-93950192-d005-41c8-842a-00815dc1047c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:52.598213 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-93950192-d005-41c8-842a-00815dc1047c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:52.600651 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-93950192-d005-41c8-842a-00815dc1047c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:52.601626 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-93950192-d005-41c8-842a-00815dc1047c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:52.602351 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-93950192-d005-41c8-842a-00815dc1047c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:52.603037 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-93950192-d005-41c8-842a-00815dc1047c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:52.612008 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-2c18af2b-3cf3-41c4-87ee-975243884fcb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:52.615856 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-2c18af2b-3cf3-41c4-87ee-975243884fcb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:52.617125 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-2c18af2b-3cf3-41c4-87ee-975243884fcb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1808 microversion: 2.20 time: 0.205279 Aug 26 00:56:52.625455 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 247/485] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:56:52 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1808 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 00:56:52.865462 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-93950192-d005-41c8-842a-00815dc1047c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:52.876112 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-93950192-d005-41c8-842a-00815dc1047c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd" status: 200 len: 1372 microversion: 2.1 time: 0.292019 Aug 26 00:56:52.881617 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 239/486] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:52 2022] GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd => generated 1372 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:53.253014 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-413da00d-3b58-4af4-aad1-cf9c258e58ae tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:53.253891 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-413da00d-3b58-4af4-aad1-cf9c258e58ae tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: cc9ceee0-65b5-48be-8dcc-7ec2a992f72d] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:53.266558 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-413da00d-3b58-4af4-aad1-cf9c258e58ae tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:53.267058 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-413da00d-3b58-4af4-aad1-cf9c258e58ae tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:53.267490 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-413da00d-3b58-4af4-aad1-cf9c258e58ae tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:53.268339 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-413da00d-3b58-4af4-aad1-cf9c258e58ae tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:53.268858 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-413da00d-3b58-4af4-aad1-cf9c258e58ae tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:53.269278 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-413da00d-3b58-4af4-aad1-cf9c258e58ae tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:53.569205 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-413da00d-3b58-4af4-aad1-cf9c258e58ae tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:53.574715 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-413da00d-3b58-4af4-aad1-cf9c258e58ae tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d" status: 200 len: 1454 microversion: 2.1 time: 0.325911 Aug 26 00:56:53.575377 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 248/487] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:53 2022] GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d => generated 1454 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:53.596182 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-3b086260-3b25-4197-b899-8f262f6c724b tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:53.596892 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-3b086260-3b25-4197-b899-8f262f6c724b tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: cc9ceee0-65b5-48be-8dcc-7ec2a992f72d] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:53.603459 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3b086260-3b25-4197-b899-8f262f6c724b tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:53.603945 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3b086260-3b25-4197-b899-8f262f6c724b tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:53.604368 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3b086260-3b25-4197-b899-8f262f6c724b tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:53.605369 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3b086260-3b25-4197-b899-8f262f6c724b tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:53.605967 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3b086260-3b25-4197-b899-8f262f6c724b tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:53.606584 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3b086260-3b25-4197-b899-8f262f6c724b tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:53.645837 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-468829fa-80bb-4c79-8eaf-b023d41440a0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:53.646170 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-468829fa-80bb-4c79-8eaf-b023d41440a0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:53.661958 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-468829fa-80bb-4c79-8eaf-b023d41440a0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:53.662838 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-468829fa-80bb-4c79-8eaf-b023d41440a0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:53.663329 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-468829fa-80bb-4c79-8eaf-b023d41440a0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:53.665246 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-468829fa-80bb-4c79-8eaf-b023d41440a0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:53.665698 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-468829fa-80bb-4c79-8eaf-b023d41440a0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:53.666126 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-468829fa-80bb-4c79-8eaf-b023d41440a0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:53.771420 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-3b086260-3b25-4197-b899-8f262f6c724b tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:53.781172 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-3b086260-3b25-4197-b899-8f262f6c724b tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d" status: 200 len: 1454 microversion: 2.1 time: 0.189429 Aug 26 00:56:53.783167 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 240/488] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:53 2022] GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d => generated 1454 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:53.882543 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-468829fa-80bb-4c79-8eaf-b023d41440a0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:53.892693 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-468829fa-80bb-4c79-8eaf-b023d41440a0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:53.894765 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-468829fa-80bb-4c79-8eaf-b023d41440a0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:53.896203 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-468829fa-80bb-4c79-8eaf-b023d41440a0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1808 microversion: 2.20 time: 0.258781 Aug 26 00:56:53.903805 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 249/489] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:56:53 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1808 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 00:56:53.918332 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-30c5808f-5a81-486d-8c3d-154f15ab3b7c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:53.919931 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-30c5808f-5a81-486d-8c3d-154f15ab3b7c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:53.929312 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-30c5808f-5a81-486d-8c3d-154f15ab3b7c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:53.930042 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-30c5808f-5a81-486d-8c3d-154f15ab3b7c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:53.930679 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-30c5808f-5a81-486d-8c3d-154f15ab3b7c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:53.931575 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-30c5808f-5a81-486d-8c3d-154f15ab3b7c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:53.932210 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-30c5808f-5a81-486d-8c3d-154f15ab3b7c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:53.932854 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-30c5808f-5a81-486d-8c3d-154f15ab3b7c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:54.120812 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-30c5808f-5a81-486d-8c3d-154f15ab3b7c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:54.129338 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-30c5808f-5a81-486d-8c3d-154f15ab3b7c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd" status: 200 len: 1372 microversion: 2.1 time: 0.216809 Aug 26 00:56:54.129946 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 241/490] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:53 2022] GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd => generated 1372 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:56:54.925339 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-733e13ed-e6a1-4382-86e9-fe568e495598 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:54.926751 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-733e13ed-e6a1-4382-86e9-fe568e495598 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:54.941381 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-733e13ed-e6a1-4382-86e9-fe568e495598 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:54.942048 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-733e13ed-e6a1-4382-86e9-fe568e495598 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:54.942677 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-733e13ed-e6a1-4382-86e9-fe568e495598 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:54.945513 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-733e13ed-e6a1-4382-86e9-fe568e495598 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:54.947194 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-733e13ed-e6a1-4382-86e9-fe568e495598 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:54.948529 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-733e13ed-e6a1-4382-86e9-fe568e495598 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:55.152307 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-733e13ed-e6a1-4382-86e9-fe568e495598 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:55.163115 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-0f66a998-249d-4d73-9174-f09f2c2c75da tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:55.166364 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-0f66a998-249d-4d73-9174-f09f2c2c75da tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:55.180788 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-733e13ed-e6a1-4382-86e9-fe568e495598 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:55.184751 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0f66a998-249d-4d73-9174-f09f2c2c75da tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:55.186503 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0f66a998-249d-4d73-9174-f09f2c2c75da tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:55.186829 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-733e13ed-e6a1-4382-86e9-fe568e495598 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:55.187881 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0f66a998-249d-4d73-9174-f09f2c2c75da tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:55.188858 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-733e13ed-e6a1-4382-86e9-fe568e495598 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1808 microversion: 2.20 time: 0.271552 Aug 26 00:56:55.194056 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0f66a998-249d-4d73-9174-f09f2c2c75da tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:55.194056 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0f66a998-249d-4d73-9174-f09f2c2c75da tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:55.197037 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 250/491] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:56:54 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1808 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:56:55.197472 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0f66a998-249d-4d73-9174-f09f2c2c75da tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:55.433278 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-0f66a998-249d-4d73-9174-f09f2c2c75da tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:55.447060 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-0f66a998-249d-4d73-9174-f09f2c2c75da tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd" status: 200 len: 1566 microversion: 2.1 time: 0.299213 Aug 26 00:56:55.448230 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 242/492] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:56:55 2022] GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd => generated 1566 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:56:55.480542 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-c828edee-ec85-41d4-b097-b77b6f68756a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:55.481274 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-c828edee-ec85-41d4-b097-b77b6f68756a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:55.488026 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c828edee-ec85-41d4-b097-b77b6f68756a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:55.488783 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c828edee-ec85-41d4-b097-b77b6f68756a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:55.489396 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c828edee-ec85-41d4-b097-b77b6f68756a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:55.490285 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c828edee-ec85-41d4-b097-b77b6f68756a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:55.491087 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c828edee-ec85-41d4-b097-b77b6f68756a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:55.491689 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c828edee-ec85-41d4-b097-b77b6f68756a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:55.621123 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-c828edee-ec85-41d4-b097-b77b6f68756a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.144641 Aug 26 00:56:55.624402 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 251/493] 10.222.0.59 () {58 vars in 1275 bytes} [Fri Aug 26 00:56:55 2022] GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd/os-interface => generated 284 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:56:56.216271 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-b05e2719-a346-40af-80c0-4cd900568523 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:56.217106 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-b05e2719-a346-40af-80c0-4cd900568523 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:56.230238 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b05e2719-a346-40af-80c0-4cd900568523 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:56.235677 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b05e2719-a346-40af-80c0-4cd900568523 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:56.238138 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b05e2719-a346-40af-80c0-4cd900568523 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:56.241115 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b05e2719-a346-40af-80c0-4cd900568523 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:56.243530 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b05e2719-a346-40af-80c0-4cd900568523 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:56.244703 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b05e2719-a346-40af-80c0-4cd900568523 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:56.477312 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-b05e2719-a346-40af-80c0-4cd900568523 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:56.496738 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-b05e2719-a346-40af-80c0-4cd900568523 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:56.498656 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-b05e2719-a346-40af-80c0-4cd900568523 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:56.499912 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-b05e2719-a346-40af-80c0-4cd900568523 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1808 microversion: 2.20 time: 0.288639 Aug 26 00:56:56.502917 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 243/494] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:56:56 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1808 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:56:57.332497 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [req-1e2feaaf-cf9a-4e15-a633-7cb3170da88f req-5c58351d-c1f5-424f-a439-bac08b2ec879 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd", "tag": "56f607c1-adc1-4120-ac0a-38b41904464e"}]} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:56:57.350191 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-1e2feaaf-cf9a-4e15-a633-7cb3170da88f req-5c58351d-c1f5-424f-a439-bac08b2ec879 service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:57.351066 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-1e2feaaf-cf9a-4e15-a633-7cb3170da88f req-5c58351d-c1f5-424f-a439-bac08b2ec879 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:57.352040 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-1e2feaaf-cf9a-4e15-a633-7cb3170da88f req-5c58351d-c1f5-424f-a439-bac08b2ec879 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:57.378414 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.compute.server_external_events [req-1e2feaaf-cf9a-4e15-a633-7cb3170da88f req-5c58351d-c1f5-424f-a439-bac08b2ec879 service nova] Creating event network-changed:56f607c1-adc1-4120-ac0a-38b41904464e for instance 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd on hv-cinder-83538 Aug 26 00:56:57.393995 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [req-1e2feaaf-cf9a-4e15-a633-7cb3170da88f req-5c58351d-c1f5-424f-a439-bac08b2ec879 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065268 Aug 26 00:56:57.395545 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 252/495] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 00:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:56:57.528080 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-dcfcdf0d-cfe4-4602-8f80-564d102bf5c7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:57.529807 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-dcfcdf0d-cfe4-4602-8f80-564d102bf5c7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:57.540611 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-dcfcdf0d-cfe4-4602-8f80-564d102bf5c7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:57.542102 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-dcfcdf0d-cfe4-4602-8f80-564d102bf5c7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:57.544773 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-dcfcdf0d-cfe4-4602-8f80-564d102bf5c7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:57.545626 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-dcfcdf0d-cfe4-4602-8f80-564d102bf5c7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:57.556915 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-dcfcdf0d-cfe4-4602-8f80-564d102bf5c7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:57.557746 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-dcfcdf0d-cfe4-4602-8f80-564d102bf5c7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:58.082429 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-dcfcdf0d-cfe4-4602-8f80-564d102bf5c7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:58.091394 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-dcfcdf0d-cfe4-4602-8f80-564d102bf5c7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:58.097522 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-dcfcdf0d-cfe4-4602-8f80-564d102bf5c7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:58.099587 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-dcfcdf0d-cfe4-4602-8f80-564d102bf5c7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1808 microversion: 2.20 time: 0.576254 Aug 26 00:56:58.103268 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 244/496] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:56:57 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1808 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:56:58.314231 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [req-f2a62866-2f21-4f44-aa84-cc89119fa3ee req-83d18a40-aae5-4a82-a4b1-5ea71f4bf280 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc9ceee0-65b5-48be-8dcc-7ec2a992f72d", "tag": "6f818c22-5eed-4378-90e3-cf3becc67582"}]} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:56:58.314231 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:56:58.314231 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-f2a62866-2f21-4f44-aa84-cc89119fa3ee req-83d18a40-aae5-4a82-a4b1-5ea71f4bf280 service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:58.314231 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-f2a62866-2f21-4f44-aa84-cc89119fa3ee req-83d18a40-aae5-4a82-a4b1-5ea71f4bf280 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:58.315308 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-f2a62866-2f21-4f44-aa84-cc89119fa3ee req-83d18a40-aae5-4a82-a4b1-5ea71f4bf280 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:58.315308 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.compute.server_external_events [req-f2a62866-2f21-4f44-aa84-cc89119fa3ee req-83d18a40-aae5-4a82-a4b1-5ea71f4bf280 service nova] Creating event network-changed:6f818c22-5eed-4378-90e3-cf3becc67582 for instance cc9ceee0-65b5-48be-8dcc-7ec2a992f72d on hv-cinder-83538 Aug 26 00:56:58.315308 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [req-f2a62866-2f21-4f44-aa84-cc89119fa3ee req-83d18a40-aae5-4a82-a4b1-5ea71f4bf280 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045423 Aug 26 00:56:58.315308 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 253/497] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 00:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:56:59.132917 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-68c3e4e8-ef5b-409b-bd7d-9e1265404840 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:56:59.134646 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-68c3e4e8-ef5b-409b-bd7d-9e1265404840 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:56:59.144179 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-68c3e4e8-ef5b-409b-bd7d-9e1265404840 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:59.144771 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-68c3e4e8-ef5b-409b-bd7d-9e1265404840 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:59.145378 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-68c3e4e8-ef5b-409b-bd7d-9e1265404840 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:59.146203 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-68c3e4e8-ef5b-409b-bd7d-9e1265404840 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:56:59.146830 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-68c3e4e8-ef5b-409b-bd7d-9e1265404840 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:56:59.147250 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-68c3e4e8-ef5b-409b-bd7d-9e1265404840 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:56:59.365393 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-68c3e4e8-ef5b-409b-bd7d-9e1265404840 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:59.381590 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-68c3e4e8-ef5b-409b-bd7d-9e1265404840 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:59.383885 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-68c3e4e8-ef5b-409b-bd7d-9e1265404840 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:56:59.386116 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-68c3e4e8-ef5b-409b-bd7d-9e1265404840 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1808 microversion: 2.20 time: 0.257970 Aug 26 00:56:59.417172 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 245/498] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:56:59 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1808 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:57:00.420155 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-951c062b-bf5c-47e5-9885-4a3f95873f63 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:57:00.420795 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-951c062b-bf5c-47e5-9885-4a3f95873f63 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:57:00.427381 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-951c062b-bf5c-47e5-9885-4a3f95873f63 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:00.428446 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-951c062b-bf5c-47e5-9885-4a3f95873f63 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:00.428446 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-951c062b-bf5c-47e5-9885-4a3f95873f63 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:00.428993 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-951c062b-bf5c-47e5-9885-4a3f95873f63 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:00.429451 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-951c062b-bf5c-47e5-9885-4a3f95873f63 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:00.429881 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-951c062b-bf5c-47e5-9885-4a3f95873f63 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:00.569663 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-951c062b-bf5c-47e5-9885-4a3f95873f63 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:00.578297 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-951c062b-bf5c-47e5-9885-4a3f95873f63 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:00.580254 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-951c062b-bf5c-47e5-9885-4a3f95873f63 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:00.581458 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-951c062b-bf5c-47e5-9885-4a3f95873f63 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1808 microversion: 2.20 time: 0.166147 Aug 26 00:57:00.582019 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 254/499] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:57:00 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:57:01.604791 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-2c354fe9-4736-482a-9b38-22ccfee2f1eb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:57:01.605393 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-2c354fe9-4736-482a-9b38-22ccfee2f1eb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:57:01.616726 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2c354fe9-4736-482a-9b38-22ccfee2f1eb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:01.617214 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2c354fe9-4736-482a-9b38-22ccfee2f1eb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:01.617706 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2c354fe9-4736-482a-9b38-22ccfee2f1eb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:01.618459 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2c354fe9-4736-482a-9b38-22ccfee2f1eb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:01.618922 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2c354fe9-4736-482a-9b38-22ccfee2f1eb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:01.621296 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2c354fe9-4736-482a-9b38-22ccfee2f1eb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:01.837721 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-2c354fe9-4736-482a-9b38-22ccfee2f1eb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:01.848108 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-2c354fe9-4736-482a-9b38-22ccfee2f1eb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:01.850583 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-2c354fe9-4736-482a-9b38-22ccfee2f1eb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:01.852008 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-2c354fe9-4736-482a-9b38-22ccfee2f1eb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1808 microversion: 2.20 time: 0.251216 Aug 26 00:57:01.888941 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 246/500] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:57:01 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1808 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:57:02.878644 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-78eaa1da-dcd9-4190-8e4b-baa8d9ba79b2 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:57:02.880187 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-78eaa1da-dcd9-4190-8e4b-baa8d9ba79b2 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:57:02.886664 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-78eaa1da-dcd9-4190-8e4b-baa8d9ba79b2 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:02.887335 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-78eaa1da-dcd9-4190-8e4b-baa8d9ba79b2 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:02.888025 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-78eaa1da-dcd9-4190-8e4b-baa8d9ba79b2 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:02.888783 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-78eaa1da-dcd9-4190-8e4b-baa8d9ba79b2 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:02.889238 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-78eaa1da-dcd9-4190-8e4b-baa8d9ba79b2 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:02.889693 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-78eaa1da-dcd9-4190-8e4b-baa8d9ba79b2 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:03.098543 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-78eaa1da-dcd9-4190-8e4b-baa8d9ba79b2 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:03.108000 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-78eaa1da-dcd9-4190-8e4b-baa8d9ba79b2 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:03.109554 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-78eaa1da-dcd9-4190-8e4b-baa8d9ba79b2 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:03.111381 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-78eaa1da-dcd9-4190-8e4b-baa8d9ba79b2 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1808 microversion: 2.20 time: 0.239141 Aug 26 00:57:03.112236 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 255/501] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:57:02 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1808 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:57:04.134320 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-b5900ab8-7ee7-4f0c-b57b-06ef5f4a7360 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:57:04.135031 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-b5900ab8-7ee7-4f0c-b57b-06ef5f4a7360 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:57:04.142236 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b5900ab8-7ee7-4f0c-b57b-06ef5f4a7360 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:04.142817 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b5900ab8-7ee7-4f0c-b57b-06ef5f4a7360 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:04.143339 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b5900ab8-7ee7-4f0c-b57b-06ef5f4a7360 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:04.144122 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b5900ab8-7ee7-4f0c-b57b-06ef5f4a7360 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:04.144674 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b5900ab8-7ee7-4f0c-b57b-06ef5f4a7360 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:04.145169 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b5900ab8-7ee7-4f0c-b57b-06ef5f4a7360 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:04.291981 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-b5900ab8-7ee7-4f0c-b57b-06ef5f4a7360 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:04.301511 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-b5900ab8-7ee7-4f0c-b57b-06ef5f4a7360 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:04.303195 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-b5900ab8-7ee7-4f0c-b57b-06ef5f4a7360 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:04.304602 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-b5900ab8-7ee7-4f0c-b57b-06ef5f4a7360 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1808 microversion: 2.20 time: 0.174159 Aug 26 00:57:04.305354 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 247/502] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:57:04 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:57:04.847047 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-000ddcd2-0ac4-457c-82f6-f5065a1c1242 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-92422748", "imageRef": "ef60327f-6e0c-4f85-8db9-6f6e8968fe9c", "flavorRef": "452"}} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:57:05.329394 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-e8bf6fa8-5c1e-474b-af93-925742cfe423 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:57:05.330668 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-e8bf6fa8-5c1e-474b-af93-925742cfe423 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:57:05.337330 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e8bf6fa8-5c1e-474b-af93-925742cfe423 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:05.337820 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e8bf6fa8-5c1e-474b-af93-925742cfe423 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:05.338260 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e8bf6fa8-5c1e-474b-af93-925742cfe423 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:05.338959 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e8bf6fa8-5c1e-474b-af93-925742cfe423 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:05.339410 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e8bf6fa8-5c1e-474b-af93-925742cfe423 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:05.339834 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e8bf6fa8-5c1e-474b-af93-925742cfe423 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:05.493508 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-e8bf6fa8-5c1e-474b-af93-925742cfe423 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:05.504420 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-e8bf6fa8-5c1e-474b-af93-925742cfe423 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:05.506032 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-e8bf6fa8-5c1e-474b-af93-925742cfe423 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:05.507430 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-e8bf6fa8-5c1e-474b-af93-925742cfe423 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1808 microversion: 2.20 time: 0.182521 Aug 26 00:57:05.513490 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 248/503] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:57:05 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:57:06.537342 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-02f63f40-ca61-4f4b-aced-2cd98297291d tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:57:06.538590 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-02f63f40-ca61-4f4b-aced-2cd98297291d tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:57:06.548373 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-02f63f40-ca61-4f4b-aced-2cd98297291d tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:06.549295 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-02f63f40-ca61-4f4b-aced-2cd98297291d tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:06.550020 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-02f63f40-ca61-4f4b-aced-2cd98297291d tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:06.550938 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-02f63f40-ca61-4f4b-aced-2cd98297291d tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:06.552291 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-02f63f40-ca61-4f4b-aced-2cd98297291d tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:06.552291 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-02f63f40-ca61-4f4b-aced-2cd98297291d tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:06.701324 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-02f63f40-ca61-4f4b-aced-2cd98297291d tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:06.711263 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-02f63f40-ca61-4f4b-aced-2cd98297291d tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:06.712755 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-02f63f40-ca61-4f4b-aced-2cd98297291d tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:06.713932 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-02f63f40-ca61-4f4b-aced-2cd98297291d tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1808 microversion: 2.20 time: 0.180758 Aug 26 00:57:06.720522 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 249/504] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:57:06 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:57:07.742580 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-48f1baed-3c2c-43ba-af65-6ec8623f3cd6 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:57:07.743390 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-48f1baed-3c2c-43ba-af65-6ec8623f3cd6 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:57:07.750880 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-48f1baed-3c2c-43ba-af65-6ec8623f3cd6 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:07.751232 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-48f1baed-3c2c-43ba-af65-6ec8623f3cd6 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:07.751679 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-48f1baed-3c2c-43ba-af65-6ec8623f3cd6 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:07.752592 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-48f1baed-3c2c-43ba-af65-6ec8623f3cd6 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:07.753051 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-48f1baed-3c2c-43ba-af65-6ec8623f3cd6 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:07.753500 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-48f1baed-3c2c-43ba-af65-6ec8623f3cd6 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:07.920154 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-48f1baed-3c2c-43ba-af65-6ec8623f3cd6 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:07.933995 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-48f1baed-3c2c-43ba-af65-6ec8623f3cd6 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:07.935480 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-48f1baed-3c2c-43ba-af65-6ec8623f3cd6 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:07.936709 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-48f1baed-3c2c-43ba-af65-6ec8623f3cd6 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1808 microversion: 2.20 time: 0.202828 Aug 26 00:57:07.937277 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 250/505] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:57:07 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1808 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 00:57:08.959589 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-ef45239a-102a-4cf2-a30a-4615fcb2f92e tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:57:08.960262 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-ef45239a-102a-4cf2-a30a-4615fcb2f92e tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:57:08.966918 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ef45239a-102a-4cf2-a30a-4615fcb2f92e tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:08.967519 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ef45239a-102a-4cf2-a30a-4615fcb2f92e tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:08.968016 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ef45239a-102a-4cf2-a30a-4615fcb2f92e tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:08.968964 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ef45239a-102a-4cf2-a30a-4615fcb2f92e tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:08.969492 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ef45239a-102a-4cf2-a30a-4615fcb2f92e tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:08.970031 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ef45239a-102a-4cf2-a30a-4615fcb2f92e tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:09.106773 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-ef45239a-102a-4cf2-a30a-4615fcb2f92e tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:09.116214 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-ef45239a-102a-4cf2-a30a-4615fcb2f92e tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:09.117823 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-ef45239a-102a-4cf2-a30a-4615fcb2f92e tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:09.119060 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-ef45239a-102a-4cf2-a30a-4615fcb2f92e tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1808 microversion: 2.20 time: 0.163865 Aug 26 00:57:09.119693 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 251/506] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:57:08 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 00:57:10.143170 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-e68e694a-1346-441e-8fff-32d389a3c8d2 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:57:10.143857 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-e68e694a-1346-441e-8fff-32d389a3c8d2 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:57:10.152822 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e68e694a-1346-441e-8fff-32d389a3c8d2 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:10.153579 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e68e694a-1346-441e-8fff-32d389a3c8d2 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:10.154258 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e68e694a-1346-441e-8fff-32d389a3c8d2 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:10.155075 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e68e694a-1346-441e-8fff-32d389a3c8d2 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:10.155631 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e68e694a-1346-441e-8fff-32d389a3c8d2 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:10.156056 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e68e694a-1346-441e-8fff-32d389a3c8d2 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:10.222283 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.network.neutron [None req-000ddcd2-0ac4-457c-82f6-f5065a1c1242 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] validate_networks() for None {{(pid=127564) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 00:57:10.339766 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-e68e694a-1346-441e-8fff-32d389a3c8d2 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:10.353967 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-e68e694a-1346-441e-8fff-32d389a3c8d2 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:10.356195 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-e68e694a-1346-441e-8fff-32d389a3c8d2 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:10.357434 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-e68e694a-1346-441e-8fff-32d389a3c8d2 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1808 microversion: 2.20 time: 0.219063 Aug 26 00:57:10.364818 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 252/507] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:57:10 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1808 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 00:57:10.563941 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.virt.hardware [None req-000ddcd2-0ac4-457c-82f6-f5065a1c1242 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Flavor limits 0:0:0 {{(pid=127564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 00:57:10.564354 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.virt.hardware [None req-000ddcd2-0ac4-457c-82f6-f5065a1c1242 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Image limits 0:0:0 {{(pid=127564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 00:57:10.564848 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.virt.hardware [None req-000ddcd2-0ac4-457c-82f6-f5065a1c1242 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Flavor pref 0:0:0 {{(pid=127564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 00:57:10.565249 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.virt.hardware [None req-000ddcd2-0ac4-457c-82f6-f5065a1c1242 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Image pref 0:0:0 {{(pid=127564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 00:57:10.565650 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.virt.hardware [None req-000ddcd2-0ac4-457c-82f6-f5065a1c1242 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 00:57:10.575508 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-000ddcd2-0ac4-457c-82f6-f5065a1c1242 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:10.575977 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-000ddcd2-0ac4-457c-82f6-f5065a1c1242 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:10.576440 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-000ddcd2-0ac4-457c-82f6-f5065a1c1242 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:10.577256 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-000ddcd2-0ac4-457c-82f6-f5065a1c1242 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:10.577711 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-000ddcd2-0ac4-457c-82f6-f5065a1c1242 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:10.578124 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-000ddcd2-0ac4-457c-82f6-f5065a1c1242 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:10.596585 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.quota [None req-000ddcd2-0ac4-457c-82f6-f5065a1c1242 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Getting quotas for project 7b6fe7a5a87c4740b32ee5e1cc1b7458. Resources: {'instances', 'ram', 'cores'} {{(pid=127564) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 00:57:10.600743 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.quota [None req-000ddcd2-0ac4-457c-82f6-f5065a1c1242 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Getting quotas for user 5c4fa4658a714288862f8a4d328f0f9c and project 7b6fe7a5a87c4740b32ee5e1cc1b7458. Resources: {'instances', 'ram', 'cores'} {{(pid=127564) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 00:57:10.612385 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-000ddcd2-0ac4-457c-82f6-f5065a1c1242 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Going to run 1 instances... {{(pid=127564) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 00:57:10.626909 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-000ddcd2-0ac4-457c-82f6-f5065a1c1242 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] [instance: 497588e0-f9a6-4c0b-9069-c4040b80cae6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ef60327f-6e0c-4f85-8db9-6f6e8968fe9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 00:57:10.781382 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-000ddcd2-0ac4-457c-82f6-f5065a1c1242 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.938349 Aug 26 00:57:10.782182 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 256/508] 10.222.0.59 () {60 vars in 1147 bytes} [Fri Aug 26 00:57:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 5940 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 00:57:10.793136 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-98a7fc91-503a-4a62-9d25-daab72150eab tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:57:10.793748 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-98a7fc91-503a-4a62-9d25-daab72150eab tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] [instance: 497588e0-f9a6-4c0b-9069-c4040b80cae6] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:57:10.853093 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-98a7fc91-503a-4a62-9d25-daab72150eab tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4fa4658a714288862f8a4d328f0f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6fe7a5a87c4740b32ee5e1cc1b7458', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:10.861266 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-98a7fc91-503a-4a62-9d25-daab72150eab tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] 10.222.0.59 "GET /compute/v2.1/servers/497588e0-f9a6-4c0b-9069-c4040b80cae6" status: 200 len: 1213 microversion: 2.1 time: 0.071521 Aug 26 00:57:10.862133 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 253/509] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:57:10 2022] GET /compute/v2.1/servers/497588e0-f9a6-4c0b-9069-c4040b80cae6 => generated 1213 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:57:11.389221 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-56b2c297-c225-4d9a-a549-269763a85df5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:57:11.389795 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-56b2c297-c225-4d9a-a549-269763a85df5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:57:11.395827 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-56b2c297-c225-4d9a-a549-269763a85df5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:11.396383 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-56b2c297-c225-4d9a-a549-269763a85df5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:11.396844 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-56b2c297-c225-4d9a-a549-269763a85df5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:11.397761 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-56b2c297-c225-4d9a-a549-269763a85df5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:11.398278 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-56b2c297-c225-4d9a-a549-269763a85df5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:11.398702 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-56b2c297-c225-4d9a-a549-269763a85df5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:11.534378 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-56b2c297-c225-4d9a-a549-269763a85df5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:11.546373 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-56b2c297-c225-4d9a-a549-269763a85df5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:11.547940 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-56b2c297-c225-4d9a-a549-269763a85df5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:11.549260 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-56b2c297-c225-4d9a-a549-269763a85df5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1808 microversion: 2.20 time: 0.164124 Aug 26 00:57:11.550036 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 257/510] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:57:11 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:57:11.881269 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-5f1b997a-2e51-4fd2-99bf-c1f6d86cd147 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:57:11.881945 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-5f1b997a-2e51-4fd2-99bf-c1f6d86cd147 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] [instance: 497588e0-f9a6-4c0b-9069-c4040b80cae6] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:57:11.941535 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-5f1b997a-2e51-4fd2-99bf-c1f6d86cd147 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4fa4658a714288862f8a4d328f0f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6fe7a5a87c4740b32ee5e1cc1b7458', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:11.951333 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-5f1b997a-2e51-4fd2-99bf-c1f6d86cd147 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] 10.222.0.59 "GET /compute/v2.1/servers/497588e0-f9a6-4c0b-9069-c4040b80cae6" status: 200 len: 1213 microversion: 2.1 time: 0.073907 Aug 26 00:57:11.951932 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 254/511] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:57:11 2022] GET /compute/v2.1/servers/497588e0-f9a6-4c0b-9069-c4040b80cae6 => generated 1213 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:57:12.573078 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-f2d1ccd5-0658-4d3f-a773-c1f30a4113e4 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:57:12.573689 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-f2d1ccd5-0658-4d3f-a773-c1f30a4113e4 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:57:12.579641 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f2d1ccd5-0658-4d3f-a773-c1f30a4113e4 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:12.580122 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f2d1ccd5-0658-4d3f-a773-c1f30a4113e4 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:12.580599 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f2d1ccd5-0658-4d3f-a773-c1f30a4113e4 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:12.581288 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f2d1ccd5-0658-4d3f-a773-c1f30a4113e4 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:12.581741 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f2d1ccd5-0658-4d3f-a773-c1f30a4113e4 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:12.582160 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f2d1ccd5-0658-4d3f-a773-c1f30a4113e4 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:12.601328 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:57:12.772781 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-f2d1ccd5-0658-4d3f-a773-c1f30a4113e4 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:12.782798 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-f2d1ccd5-0658-4d3f-a773-c1f30a4113e4 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:12.784213 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-f2d1ccd5-0658-4d3f-a773-c1f30a4113e4 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:12.792219 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-f2d1ccd5-0658-4d3f-a773-c1f30a4113e4 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1808 microversion: 2.20 time: 0.216387 Aug 26 00:57:12.792810 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 258/512] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:57:12 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1808 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:57:12.974040 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-bc5d3a84-2929-4b78-b29b-d3e3a1dc2fa8 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:57:12.974628 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-bc5d3a84-2929-4b78-b29b-d3e3a1dc2fa8 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] [instance: 497588e0-f9a6-4c0b-9069-c4040b80cae6] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:57:12.981066 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-bc5d3a84-2929-4b78-b29b-d3e3a1dc2fa8 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:12.981548 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-bc5d3a84-2929-4b78-b29b-d3e3a1dc2fa8 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:12.982078 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-bc5d3a84-2929-4b78-b29b-d3e3a1dc2fa8 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:12.982763 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-bc5d3a84-2929-4b78-b29b-d3e3a1dc2fa8 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:12.983259 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-bc5d3a84-2929-4b78-b29b-d3e3a1dc2fa8 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:12.984637 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-bc5d3a84-2929-4b78-b29b-d3e3a1dc2fa8 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:13.050064 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-bc5d3a84-2929-4b78-b29b-d3e3a1dc2fa8 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4fa4658a714288862f8a4d328f0f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6fe7a5a87c4740b32ee5e1cc1b7458', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:13.057719 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-bc5d3a84-2929-4b78-b29b-d3e3a1dc2fa8 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] 10.222.0.59 "GET /compute/v2.1/servers/497588e0-f9a6-4c0b-9069-c4040b80cae6" status: 200 len: 1209 microversion: 2.1 time: 0.087670 Aug 26 00:57:13.058272 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 255/513] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:57:12 2022] GET /compute/v2.1/servers/497588e0-f9a6-4c0b-9069-c4040b80cae6 => generated 1209 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:57:13.818623 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-80bf55bc-f78f-41ce-aff7-678c7d47bda0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:57:13.819849 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-80bf55bc-f78f-41ce-aff7-678c7d47bda0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:57:13.827565 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-80bf55bc-f78f-41ce-aff7-678c7d47bda0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:13.827565 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-80bf55bc-f78f-41ce-aff7-678c7d47bda0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:13.827565 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-80bf55bc-f78f-41ce-aff7-678c7d47bda0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:13.827565 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-80bf55bc-f78f-41ce-aff7-678c7d47bda0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:13.827994 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-80bf55bc-f78f-41ce-aff7-678c7d47bda0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:13.828661 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-80bf55bc-f78f-41ce-aff7-678c7d47bda0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:13.960532 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-80bf55bc-f78f-41ce-aff7-678c7d47bda0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:13.970200 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-80bf55bc-f78f-41ce-aff7-678c7d47bda0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:13.971552 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-80bf55bc-f78f-41ce-aff7-678c7d47bda0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:13.972793 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-80bf55bc-f78f-41ce-aff7-678c7d47bda0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1808 microversion: 2.20 time: 0.158097 Aug 26 00:57:13.973349 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 259/514] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:57:13 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:57:14.079710 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-9b1aea00-853f-4958-9dd5-c99241c49b66 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:57:14.080324 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-9b1aea00-853f-4958-9dd5-c99241c49b66 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] [instance: 497588e0-f9a6-4c0b-9069-c4040b80cae6] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:57:14.086764 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9b1aea00-853f-4958-9dd5-c99241c49b66 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:14.087269 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9b1aea00-853f-4958-9dd5-c99241c49b66 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:14.087687 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9b1aea00-853f-4958-9dd5-c99241c49b66 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:14.088377 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9b1aea00-853f-4958-9dd5-c99241c49b66 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:14.088857 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9b1aea00-853f-4958-9dd5-c99241c49b66 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:14.089308 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9b1aea00-853f-4958-9dd5-c99241c49b66 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:14.094435 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell1:SELECT=100 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:57:14.154130 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-9b1aea00-853f-4958-9dd5-c99241c49b66 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4fa4658a714288862f8a4d328f0f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6fe7a5a87c4740b32ee5e1cc1b7458', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:14.163540 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-9b1aea00-853f-4958-9dd5-c99241c49b66 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] 10.222.0.59 "GET /compute/v2.1/servers/497588e0-f9a6-4c0b-9069-c4040b80cae6" status: 200 len: 1265 microversion: 2.1 time: 0.087996 Aug 26 00:57:14.164132 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 256/515] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:57:14 2022] GET /compute/v2.1/servers/497588e0-f9a6-4c0b-9069-c4040b80cae6 => generated 1265 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:57:14.995243 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-53557335-7c59-4e6c-b7e5-a0480e18872a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:57:14.995853 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-53557335-7c59-4e6c-b7e5-a0480e18872a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:57:15.004573 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-53557335-7c59-4e6c-b7e5-a0480e18872a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:15.004573 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-53557335-7c59-4e6c-b7e5-a0480e18872a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:15.004573 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-53557335-7c59-4e6c-b7e5-a0480e18872a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:15.004573 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-53557335-7c59-4e6c-b7e5-a0480e18872a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:15.004910 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-53557335-7c59-4e6c-b7e5-a0480e18872a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:15.005249 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-53557335-7c59-4e6c-b7e5-a0480e18872a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:15.157316 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-53557335-7c59-4e6c-b7e5-a0480e18872a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:15.166238 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-53557335-7c59-4e6c-b7e5-a0480e18872a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:15.167675 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-53557335-7c59-4e6c-b7e5-a0480e18872a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:15.168885 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-53557335-7c59-4e6c-b7e5-a0480e18872a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1808 microversion: 2.20 time: 0.177525 Aug 26 00:57:15.169448 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 260/516] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:57:14 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:57:15.190467 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-0950f243-b388-406d-a725-cd7eb4fef1a3 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:57:15.192285 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-0950f243-b388-406d-a725-cd7eb4fef1a3 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] [instance: 497588e0-f9a6-4c0b-9069-c4040b80cae6] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:57:15.196153 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_api:SELECT=68 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:57:15.206491 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0950f243-b388-406d-a725-cd7eb4fef1a3 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:15.207351 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0950f243-b388-406d-a725-cd7eb4fef1a3 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:15.208122 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0950f243-b388-406d-a725-cd7eb4fef1a3 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:15.209412 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0950f243-b388-406d-a725-cd7eb4fef1a3 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:15.210286 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0950f243-b388-406d-a725-cd7eb4fef1a3 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:15.211063 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0950f243-b388-406d-a725-cd7eb4fef1a3 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:15.392194 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-0950f243-b388-406d-a725-cd7eb4fef1a3 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4fa4658a714288862f8a4d328f0f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6fe7a5a87c4740b32ee5e1cc1b7458', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:15.400210 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-0950f243-b388-406d-a725-cd7eb4fef1a3 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] 10.222.0.59 "GET /compute/v2.1/servers/497588e0-f9a6-4c0b-9069-c4040b80cae6" status: 200 len: 1313 microversion: 2.1 time: 0.219034 Aug 26 00:57:15.401408 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 257/517] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:57:15 2022] GET /compute/v2.1/servers/497588e0-f9a6-4c0b-9069-c4040b80cae6 => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:57:16.111254 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [req-903a0cdf-7eb7-4241-89c7-9d1abd1bba0f req-622754b6-d624-4262-b787-c53b14baaefe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "497588e0-f9a6-4c0b-9069-c4040b80cae6", "tag": "49428140-c8eb-4513-8f4c-d2fabf63552b"}]} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:57:16.121697 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-903a0cdf-7eb7-4241-89c7-9d1abd1bba0f req-622754b6-d624-4262-b787-c53b14baaefe service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:16.122254 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-903a0cdf-7eb7-4241-89c7-9d1abd1bba0f req-622754b6-d624-4262-b787-c53b14baaefe service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:16.122745 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-903a0cdf-7eb7-4241-89c7-9d1abd1bba0f req-622754b6-d624-4262-b787-c53b14baaefe service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:16.135214 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.compute.server_external_events [req-903a0cdf-7eb7-4241-89c7-9d1abd1bba0f req-622754b6-d624-4262-b787-c53b14baaefe service nova] Creating event network-changed:49428140-c8eb-4513-8f4c-d2fabf63552b for instance 497588e0-f9a6-4c0b-9069-c4040b80cae6 on hv-cinder-83538 Aug 26 00:57:16.140399 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [req-903a0cdf-7eb7-4241-89c7-9d1abd1bba0f req-622754b6-d624-4262-b787-c53b14baaefe service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033386 Aug 26 00:57:16.141054 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 261/518] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 00:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:57:16.191260 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-bbd6ea22-945a-46cd-b71a-37c032263f1f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:57:16.191873 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-bbd6ea22-945a-46cd-b71a-37c032263f1f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:57:16.198920 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-bbd6ea22-945a-46cd-b71a-37c032263f1f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:16.199692 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-bbd6ea22-945a-46cd-b71a-37c032263f1f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:16.200181 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-bbd6ea22-945a-46cd-b71a-37c032263f1f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:16.201127 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-bbd6ea22-945a-46cd-b71a-37c032263f1f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:16.201582 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-bbd6ea22-945a-46cd-b71a-37c032263f1f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:16.202005 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-bbd6ea22-945a-46cd-b71a-37c032263f1f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:16.340161 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-bbd6ea22-945a-46cd-b71a-37c032263f1f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:16.349853 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-bbd6ea22-945a-46cd-b71a-37c032263f1f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:16.351281 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-bbd6ea22-945a-46cd-b71a-37c032263f1f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:16.352605 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-bbd6ea22-945a-46cd-b71a-37c032263f1f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1808 microversion: 2.20 time: 0.165290 Aug 26 00:57:16.353167 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 258/519] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:57:16 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:57:16.427587 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-43984bb2-5ef2-4321-a889-74be581d0498 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:57:16.428200 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-43984bb2-5ef2-4321-a889-74be581d0498 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] [instance: 497588e0-f9a6-4c0b-9069-c4040b80cae6] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:57:16.435165 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-43984bb2-5ef2-4321-a889-74be581d0498 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:16.435654 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-43984bb2-5ef2-4321-a889-74be581d0498 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:16.436125 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-43984bb2-5ef2-4321-a889-74be581d0498 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:16.436855 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-43984bb2-5ef2-4321-a889-74be581d0498 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:16.437305 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-43984bb2-5ef2-4321-a889-74be581d0498 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:16.437728 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-43984bb2-5ef2-4321-a889-74be581d0498 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:16.652994 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-43984bb2-5ef2-4321-a889-74be581d0498 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4fa4658a714288862f8a4d328f0f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6fe7a5a87c4740b32ee5e1cc1b7458', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:16.660972 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-43984bb2-5ef2-4321-a889-74be581d0498 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] 10.222.0.59 "GET /compute/v2.1/servers/497588e0-f9a6-4c0b-9069-c4040b80cae6" status: 200 len: 1313 microversion: 2.1 time: 0.237748 Aug 26 00:57:16.661632 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 262/520] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:57:16 2022] GET /compute/v2.1/servers/497588e0-f9a6-4c0b-9069-c4040b80cae6 => generated 1313 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:57:17.375545 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-331c1956-206b-4550-85f2-1ad5d32628e0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:57:17.377361 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-331c1956-206b-4550-85f2-1ad5d32628e0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:57:17.383258 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-331c1956-206b-4550-85f2-1ad5d32628e0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:17.383731 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-331c1956-206b-4550-85f2-1ad5d32628e0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:17.384202 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-331c1956-206b-4550-85f2-1ad5d32628e0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:17.385090 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-331c1956-206b-4550-85f2-1ad5d32628e0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:17.385541 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-331c1956-206b-4550-85f2-1ad5d32628e0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:17.385962 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-331c1956-206b-4550-85f2-1ad5d32628e0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:17.521518 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-331c1956-206b-4550-85f2-1ad5d32628e0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:17.530989 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-331c1956-206b-4550-85f2-1ad5d32628e0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:17.533404 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-331c1956-206b-4550-85f2-1ad5d32628e0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:17.534617 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-331c1956-206b-4550-85f2-1ad5d32628e0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1808 microversion: 2.20 time: 0.163186 Aug 26 00:57:17.535221 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 259/521] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:57:17 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:57:17.682133 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-4c54adcc-2311-4342-bc20-ef04825392db tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:57:17.682666 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-4c54adcc-2311-4342-bc20-ef04825392db tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] [instance: 497588e0-f9a6-4c0b-9069-c4040b80cae6] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:57:17.688910 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-4c54adcc-2311-4342-bc20-ef04825392db tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:17.689459 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-4c54adcc-2311-4342-bc20-ef04825392db tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:17.693325 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-4c54adcc-2311-4342-bc20-ef04825392db tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:17.693325 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-4c54adcc-2311-4342-bc20-ef04825392db tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:17.693325 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-4c54adcc-2311-4342-bc20-ef04825392db tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:17.693325 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-4c54adcc-2311-4342-bc20-ef04825392db tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:17.828761 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-4c54adcc-2311-4342-bc20-ef04825392db tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4fa4658a714288862f8a4d328f0f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6fe7a5a87c4740b32ee5e1cc1b7458', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:17.836795 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-4c54adcc-2311-4342-bc20-ef04825392db tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] 10.222.0.59 "GET /compute/v2.1/servers/497588e0-f9a6-4c0b-9069-c4040b80cae6" status: 200 len: 1313 microversion: 2.1 time: 0.158683 Aug 26 00:57:17.838036 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 263/522] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:57:17 2022] GET /compute/v2.1/servers/497588e0-f9a6-4c0b-9069-c4040b80cae6 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:57:18.558472 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-c3c4b164-e0ae-4910-9528-c8c3e3457892 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:57:18.559072 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-c3c4b164-e0ae-4910-9528-c8c3e3457892 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:57:18.565649 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c3c4b164-e0ae-4910-9528-c8c3e3457892 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:18.566119 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c3c4b164-e0ae-4910-9528-c8c3e3457892 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:18.566543 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c3c4b164-e0ae-4910-9528-c8c3e3457892 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:18.567216 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c3c4b164-e0ae-4910-9528-c8c3e3457892 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:18.567653 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c3c4b164-e0ae-4910-9528-c8c3e3457892 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:18.568065 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c3c4b164-e0ae-4910-9528-c8c3e3457892 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:18.697133 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-c3c4b164-e0ae-4910-9528-c8c3e3457892 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:18.706244 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-c3c4b164-e0ae-4910-9528-c8c3e3457892 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:18.707670 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-c3c4b164-e0ae-4910-9528-c8c3e3457892 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:18.708858 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-c3c4b164-e0ae-4910-9528-c8c3e3457892 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1808 microversion: 2.20 time: 0.154351 Aug 26 00:57:18.709413 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 260/523] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:57:18 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 00:57:18.859415 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-c1eb8713-eb1c-4475-83ff-a62a0a9bb840 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:57:18.860023 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-c1eb8713-eb1c-4475-83ff-a62a0a9bb840 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] [instance: 497588e0-f9a6-4c0b-9069-c4040b80cae6] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:57:18.866299 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c1eb8713-eb1c-4475-83ff-a62a0a9bb840 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:18.866781 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c1eb8713-eb1c-4475-83ff-a62a0a9bb840 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:18.867213 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c1eb8713-eb1c-4475-83ff-a62a0a9bb840 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:18.867904 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c1eb8713-eb1c-4475-83ff-a62a0a9bb840 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:18.868356 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c1eb8713-eb1c-4475-83ff-a62a0a9bb840 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:18.868813 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c1eb8713-eb1c-4475-83ff-a62a0a9bb840 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:19.012024 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-c1eb8713-eb1c-4475-83ff-a62a0a9bb840 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4fa4658a714288862f8a4d328f0f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6fe7a5a87c4740b32ee5e1cc1b7458', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:19.020384 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-c1eb8713-eb1c-4475-83ff-a62a0a9bb840 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] 10.222.0.59 "GET /compute/v2.1/servers/497588e0-f9a6-4c0b-9069-c4040b80cae6" status: 200 len: 1313 microversion: 2.1 time: 0.165070 Aug 26 00:57:19.021019 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 264/524] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:57:18 2022] GET /compute/v2.1/servers/497588e0-f9a6-4c0b-9069-c4040b80cae6 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:57:19.732264 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-e56b1b69-8336-49ae-8543-15a9e5594c31 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:57:19.732877 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-e56b1b69-8336-49ae-8543-15a9e5594c31 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:57:19.739604 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e56b1b69-8336-49ae-8543-15a9e5594c31 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:19.740021 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e56b1b69-8336-49ae-8543-15a9e5594c31 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:19.740455 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e56b1b69-8336-49ae-8543-15a9e5594c31 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:19.741180 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e56b1b69-8336-49ae-8543-15a9e5594c31 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:19.741647 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e56b1b69-8336-49ae-8543-15a9e5594c31 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:19.742116 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e56b1b69-8336-49ae-8543-15a9e5594c31 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:19.883120 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-e56b1b69-8336-49ae-8543-15a9e5594c31 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:19.891666 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-e56b1b69-8336-49ae-8543-15a9e5594c31 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:19.893121 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-e56b1b69-8336-49ae-8543-15a9e5594c31 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:19.894294 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-e56b1b69-8336-49ae-8543-15a9e5594c31 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1808 microversion: 2.20 time: 0.166031 Aug 26 00:57:19.894848 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 261/525] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:57:19 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:57:20.041256 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-d1facd00-73ff-4684-8347-cb6349876c97 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:57:20.041788 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-d1facd00-73ff-4684-8347-cb6349876c97 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] [instance: 497588e0-f9a6-4c0b-9069-c4040b80cae6] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:57:20.048603 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-d1facd00-73ff-4684-8347-cb6349876c97 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:20.049093 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-d1facd00-73ff-4684-8347-cb6349876c97 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:20.049529 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-d1facd00-73ff-4684-8347-cb6349876c97 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:20.050378 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-d1facd00-73ff-4684-8347-cb6349876c97 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:20.050826 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-d1facd00-73ff-4684-8347-cb6349876c97 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:20.051253 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-d1facd00-73ff-4684-8347-cb6349876c97 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:20.190562 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-d1facd00-73ff-4684-8347-cb6349876c97 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4fa4658a714288862f8a4d328f0f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6fe7a5a87c4740b32ee5e1cc1b7458', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:20.198742 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-d1facd00-73ff-4684-8347-cb6349876c97 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] 10.222.0.59 "GET /compute/v2.1/servers/497588e0-f9a6-4c0b-9069-c4040b80cae6" status: 200 len: 1313 microversion: 2.1 time: 0.161941 Aug 26 00:57:20.199322 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 265/526] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:57:20 2022] GET /compute/v2.1/servers/497588e0-f9a6-4c0b-9069-c4040b80cae6 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:57:20.916860 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-270638fc-c010-4a35-b173-d30a34378e84 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:57:20.917462 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-270638fc-c010-4a35-b173-d30a34378e84 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:57:20.924544 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-270638fc-c010-4a35-b173-d30a34378e84 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:20.925024 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-270638fc-c010-4a35-b173-d30a34378e84 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:20.925450 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-270638fc-c010-4a35-b173-d30a34378e84 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:20.926127 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-270638fc-c010-4a35-b173-d30a34378e84 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:20.926569 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-270638fc-c010-4a35-b173-d30a34378e84 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:20.926982 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-270638fc-c010-4a35-b173-d30a34378e84 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:21.059047 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-270638fc-c010-4a35-b173-d30a34378e84 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:21.067518 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-270638fc-c010-4a35-b173-d30a34378e84 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:21.068967 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-270638fc-c010-4a35-b173-d30a34378e84 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:21.070106 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-270638fc-c010-4a35-b173-d30a34378e84 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1808 microversion: 2.20 time: 0.157438 Aug 26 00:57:21.070654 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 262/527] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:57:20 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:57:21.220293 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-934cff79-cc4b-494c-b82c-4dee3c12405b tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:57:21.220951 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-934cff79-cc4b-494c-b82c-4dee3c12405b tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] [instance: 497588e0-f9a6-4c0b-9069-c4040b80cae6] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:57:21.222942 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell0:SELECT=2 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:57:21.224220 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell0:SELECT=6 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:57:21.235615 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-934cff79-cc4b-494c-b82c-4dee3c12405b tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:21.235615 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-934cff79-cc4b-494c-b82c-4dee3c12405b tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:21.236392 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-934cff79-cc4b-494c-b82c-4dee3c12405b tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:21.237412 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-934cff79-cc4b-494c-b82c-4dee3c12405b tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:21.243765 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-934cff79-cc4b-494c-b82c-4dee3c12405b tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:21.243765 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-934cff79-cc4b-494c-b82c-4dee3c12405b tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:21.385361 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-934cff79-cc4b-494c-b82c-4dee3c12405b tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4fa4658a714288862f8a4d328f0f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6fe7a5a87c4740b32ee5e1cc1b7458', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:21.393768 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-934cff79-cc4b-494c-b82c-4dee3c12405b tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] 10.222.0.59 "GET /compute/v2.1/servers/497588e0-f9a6-4c0b-9069-c4040b80cae6" status: 200 len: 1313 microversion: 2.1 time: 0.178187 Aug 26 00:57:21.394594 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 266/528] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:57:21 2022] GET /compute/v2.1/servers/497588e0-f9a6-4c0b-9069-c4040b80cae6 => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:57:21.449803 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [req-97e558bb-8bb5-4b65-8973-64a070d4fa2d req-310b2954-cdc0-4de3-a0d1-4fcfbc4348e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "497588e0-f9a6-4c0b-9069-c4040b80cae6", "name": "network-vif-plugged", "status": "completed", "tag": "49428140-c8eb-4513-8f4c-d2fabf63552b"}]} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:57:21.459986 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-97e558bb-8bb5-4b65-8973-64a070d4fa2d req-310b2954-cdc0-4de3-a0d1-4fcfbc4348e4 service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:21.460584 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-97e558bb-8bb5-4b65-8973-64a070d4fa2d req-310b2954-cdc0-4de3-a0d1-4fcfbc4348e4 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:21.461022 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-97e558bb-8bb5-4b65-8973-64a070d4fa2d req-310b2954-cdc0-4de3-a0d1-4fcfbc4348e4 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:21.474552 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.compute.server_external_events [req-97e558bb-8bb5-4b65-8973-64a070d4fa2d req-310b2954-cdc0-4de3-a0d1-4fcfbc4348e4 service nova] Creating event network-vif-plugged:49428140-c8eb-4513-8f4c-d2fabf63552b for instance 497588e0-f9a6-4c0b-9069-c4040b80cae6 on hv-cinder-83538 Aug 26 00:57:21.484680 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [req-97e558bb-8bb5-4b65-8973-64a070d4fa2d req-310b2954-cdc0-4de3-a0d1-4fcfbc4348e4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038265 Aug 26 00:57:21.485695 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 263/529] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 00:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:57:22.092892 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-72ae8a26-be85-4af2-b304-d0282021c52a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:57:22.093514 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-72ae8a26-be85-4af2-b304-d0282021c52a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:57:22.100055 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-72ae8a26-be85-4af2-b304-d0282021c52a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:22.100574 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-72ae8a26-be85-4af2-b304-d0282021c52a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:22.101015 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-72ae8a26-be85-4af2-b304-d0282021c52a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:22.101789 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-72ae8a26-be85-4af2-b304-d0282021c52a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:22.102254 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-72ae8a26-be85-4af2-b304-d0282021c52a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:22.102680 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-72ae8a26-be85-4af2-b304-d0282021c52a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:22.236754 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-72ae8a26-be85-4af2-b304-d0282021c52a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:22.258189 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-72ae8a26-be85-4af2-b304-d0282021c52a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:22.258189 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-72ae8a26-be85-4af2-b304-d0282021c52a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:22.258189 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-72ae8a26-be85-4af2-b304-d0282021c52a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1808 microversion: 2.20 time: 0.159702 Aug 26 00:57:22.258528 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 267/530] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:57:22 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:57:22.415829 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-a9ca9f9d-ec44-4c15-9289-aad4140c99b4 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:57:22.416539 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-a9ca9f9d-ec44-4c15-9289-aad4140c99b4 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] [instance: 497588e0-f9a6-4c0b-9069-c4040b80cae6] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:57:22.418993 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell0:SELECT=4 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:57:22.424376 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a9ca9f9d-ec44-4c15-9289-aad4140c99b4 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:22.424952 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a9ca9f9d-ec44-4c15-9289-aad4140c99b4 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:22.425381 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a9ca9f9d-ec44-4c15-9289-aad4140c99b4 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:22.426096 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a9ca9f9d-ec44-4c15-9289-aad4140c99b4 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:22.426541 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a9ca9f9d-ec44-4c15-9289-aad4140c99b4 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:22.426956 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a9ca9f9d-ec44-4c15-9289-aad4140c99b4 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:22.565950 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-a9ca9f9d-ec44-4c15-9289-aad4140c99b4 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4fa4658a714288862f8a4d328f0f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6fe7a5a87c4740b32ee5e1cc1b7458', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:22.574035 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-a9ca9f9d-ec44-4c15-9289-aad4140c99b4 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] 10.222.0.59 "GET /compute/v2.1/servers/497588e0-f9a6-4c0b-9069-c4040b80cae6" status: 200 len: 1313 microversion: 2.1 time: 0.162934 Aug 26 00:57:22.574541 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 264/531] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:57:22 2022] GET /compute/v2.1/servers/497588e0-f9a6-4c0b-9069-c4040b80cae6 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:57:23.273792 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-47702140-b6e0-4c46-ac41-85a285c7cb6b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:57:23.275074 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-47702140-b6e0-4c46-ac41-85a285c7cb6b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:57:23.281862 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-47702140-b6e0-4c46-ac41-85a285c7cb6b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:23.282706 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-47702140-b6e0-4c46-ac41-85a285c7cb6b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:23.283539 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-47702140-b6e0-4c46-ac41-85a285c7cb6b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:23.284727 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-47702140-b6e0-4c46-ac41-85a285c7cb6b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:23.285400 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-47702140-b6e0-4c46-ac41-85a285c7cb6b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:23.286717 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-47702140-b6e0-4c46-ac41-85a285c7cb6b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:23.471500 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-47702140-b6e0-4c46-ac41-85a285c7cb6b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:23.480328 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-47702140-b6e0-4c46-ac41-85a285c7cb6b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:23.481860 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-47702140-b6e0-4c46-ac41-85a285c7cb6b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:23.483012 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-47702140-b6e0-4c46-ac41-85a285c7cb6b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1808 microversion: 2.20 time: 0.213952 Aug 26 00:57:23.483566 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 268/532] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:57:23 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1808 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:57:23.520451 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [req-f559c093-f77b-40be-a545-6794b9a3a39c req-3ecd3661-25af-4bf7-9a48-31a63321449b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7502d0cf-4abc-484b-8c85-d8ea6682333b", "name": "network-vif-plugged", "status": "completed", "tag": "ee6ad2fb-f57e-474d-a46b-a0d19ae36479"}]} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:57:23.533268 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-f559c093-f77b-40be-a545-6794b9a3a39c req-3ecd3661-25af-4bf7-9a48-31a63321449b service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:23.534029 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-f559c093-f77b-40be-a545-6794b9a3a39c req-3ecd3661-25af-4bf7-9a48-31a63321449b service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:23.534332 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-f559c093-f77b-40be-a545-6794b9a3a39c req-3ecd3661-25af-4bf7-9a48-31a63321449b service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:23.554828 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.compute.server_external_events [req-f559c093-f77b-40be-a545-6794b9a3a39c req-3ecd3661-25af-4bf7-9a48-31a63321449b service nova] Creating event network-vif-plugged:ee6ad2fb-f57e-474d-a46b-a0d19ae36479 for instance 7502d0cf-4abc-484b-8c85-d8ea6682333b on hv-cinder-83538 Aug 26 00:57:23.560152 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [req-f559c093-f77b-40be-a545-6794b9a3a39c req-3ecd3661-25af-4bf7-9a48-31a63321449b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044220 Aug 26 00:57:23.561136 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 265/533] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 00:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:57:23.595562 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-b3017b0f-4fea-4d75-af35-45b2a8ddaa6d tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:57:23.596314 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-b3017b0f-4fea-4d75-af35-45b2a8ddaa6d tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] [instance: 497588e0-f9a6-4c0b-9069-c4040b80cae6] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:57:23.603972 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b3017b0f-4fea-4d75-af35-45b2a8ddaa6d tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:23.604494 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b3017b0f-4fea-4d75-af35-45b2a8ddaa6d tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:23.604956 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b3017b0f-4fea-4d75-af35-45b2a8ddaa6d tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:23.605644 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b3017b0f-4fea-4d75-af35-45b2a8ddaa6d tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:23.606131 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b3017b0f-4fea-4d75-af35-45b2a8ddaa6d tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:23.606658 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b3017b0f-4fea-4d75-af35-45b2a8ddaa6d tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:23.745515 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-b3017b0f-4fea-4d75-af35-45b2a8ddaa6d tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4fa4658a714288862f8a4d328f0f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6fe7a5a87c4740b32ee5e1cc1b7458', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:23.753521 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-b3017b0f-4fea-4d75-af35-45b2a8ddaa6d tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] 10.222.0.59 "GET /compute/v2.1/servers/497588e0-f9a6-4c0b-9069-c4040b80cae6" status: 200 len: 1313 microversion: 2.1 time: 0.162248 Aug 26 00:57:23.763954 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 269/534] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:57:23 2022] GET /compute/v2.1/servers/497588e0-f9a6-4c0b-9069-c4040b80cae6 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:57:24.507316 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-9cce32b6-b871-44a2-880e-16800ebd33b9 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:57:24.508059 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-9cce32b6-b871-44a2-880e-16800ebd33b9 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:57:24.514588 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9cce32b6-b871-44a2-880e-16800ebd33b9 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:24.515059 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9cce32b6-b871-44a2-880e-16800ebd33b9 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:24.515528 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9cce32b6-b871-44a2-880e-16800ebd33b9 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:24.516214 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9cce32b6-b871-44a2-880e-16800ebd33b9 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:24.516766 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9cce32b6-b871-44a2-880e-16800ebd33b9 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:24.517139 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9cce32b6-b871-44a2-880e-16800ebd33b9 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:24.675425 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-9cce32b6-b871-44a2-880e-16800ebd33b9 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:24.684395 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-9cce32b6-b871-44a2-880e-16800ebd33b9 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:24.686093 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-9cce32b6-b871-44a2-880e-16800ebd33b9 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:24.687294 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-9cce32b6-b871-44a2-880e-16800ebd33b9 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1808 microversion: 2.20 time: 0.184306 Aug 26 00:57:24.688486 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 266/535] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:57:24 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:57:24.774421 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-772f85ec-bc05-4ca2-b2c3-3d692d8f995e tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:57:24.775014 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-772f85ec-bc05-4ca2-b2c3-3d692d8f995e tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] [instance: 497588e0-f9a6-4c0b-9069-c4040b80cae6] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:57:24.787381 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-772f85ec-bc05-4ca2-b2c3-3d692d8f995e tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:24.788215 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-772f85ec-bc05-4ca2-b2c3-3d692d8f995e tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:24.788644 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-772f85ec-bc05-4ca2-b2c3-3d692d8f995e tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:24.789484 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-772f85ec-bc05-4ca2-b2c3-3d692d8f995e tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:24.791791 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-772f85ec-bc05-4ca2-b2c3-3d692d8f995e tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:24.792786 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-772f85ec-bc05-4ca2-b2c3-3d692d8f995e tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:24.927402 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-772f85ec-bc05-4ca2-b2c3-3d692d8f995e tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4fa4658a714288862f8a4d328f0f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6fe7a5a87c4740b32ee5e1cc1b7458', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:24.935229 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-772f85ec-bc05-4ca2-b2c3-3d692d8f995e tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] 10.222.0.59 "GET /compute/v2.1/servers/497588e0-f9a6-4c0b-9069-c4040b80cae6" status: 200 len: 1462 microversion: 2.1 time: 0.164629 Aug 26 00:57:24.936002 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 270/536] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:57:24 2022] GET /compute/v2.1/servers/497588e0-f9a6-4c0b-9069-c4040b80cae6 => generated 1462 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:57:24.988003 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-018c741e-a0e6-4960-b9df-e74f468c29ef tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:57:24.988667 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-018c741e-a0e6-4960-b9df-e74f468c29ef tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] [instance: 497588e0-f9a6-4c0b-9069-c4040b80cae6] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:57:24.994761 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-018c741e-a0e6-4960-b9df-e74f468c29ef tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:24.995437 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-018c741e-a0e6-4960-b9df-e74f468c29ef tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:24.995915 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-018c741e-a0e6-4960-b9df-e74f468c29ef tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:24.996674 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-018c741e-a0e6-4960-b9df-e74f468c29ef tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:24.997183 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-018c741e-a0e6-4960-b9df-e74f468c29ef tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:24.997642 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-018c741e-a0e6-4960-b9df-e74f468c29ef tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:25.023859 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-018c741e-a0e6-4960-b9df-e74f468c29ef tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] [instance: 497588e0-f9a6-4c0b-9069-c4040b80cae6] Going to try to terminate instance {{(pid=127565) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 00:57:25.304166 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-018c741e-a0e6-4960-b9df-e74f468c29ef tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] 10.222.0.59 "DELETE /compute/v2.1/servers/497588e0-f9a6-4c0b-9069-c4040b80cae6" status: 204 len: 0 microversion: 2.1 time: 0.320345 Aug 26 00:57:25.304891 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 267/537] 10.222.0.59 () {58 vars in 1239 bytes} [Fri Aug 26 00:57:24 2022] DELETE /compute/v2.1/servers/497588e0-f9a6-4c0b-9069-c4040b80cae6 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 00:57:25.313201 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-ec2fc89d-12e8-4b42-b032-a0a4861f1fd8 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:57:25.313810 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-ec2fc89d-12e8-4b42-b032-a0a4861f1fd8 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] [instance: 497588e0-f9a6-4c0b-9069-c4040b80cae6] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:57:25.319906 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ec2fc89d-12e8-4b42-b032-a0a4861f1fd8 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:25.320516 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ec2fc89d-12e8-4b42-b032-a0a4861f1fd8 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:25.321059 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ec2fc89d-12e8-4b42-b032-a0a4861f1fd8 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:25.321745 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ec2fc89d-12e8-4b42-b032-a0a4861f1fd8 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:25.322383 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ec2fc89d-12e8-4b42-b032-a0a4861f1fd8 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:25.322848 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ec2fc89d-12e8-4b42-b032-a0a4861f1fd8 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:25.458211 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-ec2fc89d-12e8-4b42-b032-a0a4861f1fd8 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4fa4658a714288862f8a4d328f0f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6fe7a5a87c4740b32ee5e1cc1b7458', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:25.466358 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-ec2fc89d-12e8-4b42-b032-a0a4861f1fd8 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] 10.222.0.59 "GET /compute/v2.1/servers/497588e0-f9a6-4c0b-9069-c4040b80cae6" status: 200 len: 1468 microversion: 2.1 time: 0.157130 Aug 26 00:57:25.466986 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 271/538] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:57:25 2022] GET /compute/v2.1/servers/497588e0-f9a6-4c0b-9069-c4040b80cae6 => generated 1468 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:57:25.711746 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-d7cece5a-aa83-4d6d-979a-f53b6e7c6f11 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:57:25.712495 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-d7cece5a-aa83-4d6d-979a-f53b6e7c6f11 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:57:25.720808 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d7cece5a-aa83-4d6d-979a-f53b6e7c6f11 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:25.721420 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d7cece5a-aa83-4d6d-979a-f53b6e7c6f11 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:25.721981 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d7cece5a-aa83-4d6d-979a-f53b6e7c6f11 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:25.722837 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d7cece5a-aa83-4d6d-979a-f53b6e7c6f11 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:25.723398 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d7cece5a-aa83-4d6d-979a-f53b6e7c6f11 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:25.723834 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d7cece5a-aa83-4d6d-979a-f53b6e7c6f11 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:25.865367 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-d7cece5a-aa83-4d6d-979a-f53b6e7c6f11 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:25.874172 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-d7cece5a-aa83-4d6d-979a-f53b6e7c6f11 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:25.875638 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-d7cece5a-aa83-4d6d-979a-f53b6e7c6f11 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:25.876839 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-d7cece5a-aa83-4d6d-979a-f53b6e7c6f11 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1808 microversion: 2.20 time: 0.169422 Aug 26 00:57:25.877390 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 268/539] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:57:25 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:57:26.489281 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-9beb2a63-f52d-455b-bacd-1e0e1d6508d0 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:57:26.489896 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-9beb2a63-f52d-455b-bacd-1e0e1d6508d0 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] [instance: 497588e0-f9a6-4c0b-9069-c4040b80cae6] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:57:26.496037 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9beb2a63-f52d-455b-bacd-1e0e1d6508d0 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:26.496585 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9beb2a63-f52d-455b-bacd-1e0e1d6508d0 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:26.497021 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9beb2a63-f52d-455b-bacd-1e0e1d6508d0 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:26.497710 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9beb2a63-f52d-455b-bacd-1e0e1d6508d0 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:26.498161 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9beb2a63-f52d-455b-bacd-1e0e1d6508d0 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:26.498586 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9beb2a63-f52d-455b-bacd-1e0e1d6508d0 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:26.631221 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-9beb2a63-f52d-455b-bacd-1e0e1d6508d0 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4fa4658a714288862f8a4d328f0f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6fe7a5a87c4740b32ee5e1cc1b7458', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:26.638929 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-9beb2a63-f52d-455b-bacd-1e0e1d6508d0 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] 10.222.0.59 "GET /compute/v2.1/servers/497588e0-f9a6-4c0b-9069-c4040b80cae6" status: 200 len: 1468 microversion: 2.1 time: 0.153640 Aug 26 00:57:26.639496 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 272/540] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:57:26 2022] GET /compute/v2.1/servers/497588e0-f9a6-4c0b-9069-c4040b80cae6 => generated 1468 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:57:26.899712 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-3d8b0535-579d-47a1-848f-560f9db98384 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:57:26.900372 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-3d8b0535-579d-47a1-848f-560f9db98384 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:57:26.907481 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3d8b0535-579d-47a1-848f-560f9db98384 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:26.907959 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3d8b0535-579d-47a1-848f-560f9db98384 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:26.908390 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3d8b0535-579d-47a1-848f-560f9db98384 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:26.909267 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3d8b0535-579d-47a1-848f-560f9db98384 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:26.909719 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3d8b0535-579d-47a1-848f-560f9db98384 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:26.910141 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3d8b0535-579d-47a1-848f-560f9db98384 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:27.044209 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-3d8b0535-579d-47a1-848f-560f9db98384 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:27.053271 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-3d8b0535-579d-47a1-848f-560f9db98384 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:27.054775 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-3d8b0535-579d-47a1-848f-560f9db98384 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:27.056017 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-3d8b0535-579d-47a1-848f-560f9db98384 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1808 microversion: 2.20 time: 0.160059 Aug 26 00:57:27.056656 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 269/541] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:57:26 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:57:27.661015 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-3dd0be8a-bbf3-460a-b72d-39b9d6ec4608 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:57:27.661624 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-3dd0be8a-bbf3-460a-b72d-39b9d6ec4608 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] [instance: 497588e0-f9a6-4c0b-9069-c4040b80cae6] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:57:27.667694 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3dd0be8a-bbf3-460a-b72d-39b9d6ec4608 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:27.668170 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3dd0be8a-bbf3-460a-b72d-39b9d6ec4608 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:27.668639 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3dd0be8a-bbf3-460a-b72d-39b9d6ec4608 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:27.669316 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3dd0be8a-bbf3-460a-b72d-39b9d6ec4608 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:27.669759 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3dd0be8a-bbf3-460a-b72d-39b9d6ec4608 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:27.670184 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3dd0be8a-bbf3-460a-b72d-39b9d6ec4608 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:27.800148 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-3dd0be8a-bbf3-460a-b72d-39b9d6ec4608 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4fa4658a714288862f8a4d328f0f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6fe7a5a87c4740b32ee5e1cc1b7458', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:27.807756 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-3dd0be8a-bbf3-460a-b72d-39b9d6ec4608 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] 10.222.0.59 "GET /compute/v2.1/servers/497588e0-f9a6-4c0b-9069-c4040b80cae6" status: 200 len: 1468 microversion: 2.1 time: 0.150611 Aug 26 00:57:27.808309 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 273/542] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:57:27 2022] GET /compute/v2.1/servers/497588e0-f9a6-4c0b-9069-c4040b80cae6 => generated 1468 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:57:28.079975 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-b4c288b0-6f68-4ccc-9985-462e72739b63 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:57:28.080611 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-b4c288b0-6f68-4ccc-9985-462e72739b63 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:57:28.087407 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b4c288b0-6f68-4ccc-9985-462e72739b63 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:28.087890 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b4c288b0-6f68-4ccc-9985-462e72739b63 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:28.088327 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b4c288b0-6f68-4ccc-9985-462e72739b63 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:28.089044 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b4c288b0-6f68-4ccc-9985-462e72739b63 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:28.089498 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b4c288b0-6f68-4ccc-9985-462e72739b63 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:28.093642 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b4c288b0-6f68-4ccc-9985-462e72739b63 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:28.227943 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-b4c288b0-6f68-4ccc-9985-462e72739b63 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:28.237596 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-b4c288b0-6f68-4ccc-9985-462e72739b63 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:28.239017 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-b4c288b0-6f68-4ccc-9985-462e72739b63 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:28.240205 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-b4c288b0-6f68-4ccc-9985-462e72739b63 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1808 microversion: 2.20 time: 0.164788 Aug 26 00:57:28.240997 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 270/543] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:57:28 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:57:28.829305 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-7296fe0c-7ec3-4bfb-a077-9c8a5d2e7783 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:57:28.829923 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-7296fe0c-7ec3-4bfb-a077-9c8a5d2e7783 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] [instance: 497588e0-f9a6-4c0b-9069-c4040b80cae6] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:57:28.835891 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-7296fe0c-7ec3-4bfb-a077-9c8a5d2e7783 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:28.836380 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-7296fe0c-7ec3-4bfb-a077-9c8a5d2e7783 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:28.836864 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-7296fe0c-7ec3-4bfb-a077-9c8a5d2e7783 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:28.837554 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-7296fe0c-7ec3-4bfb-a077-9c8a5d2e7783 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:28.838013 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-7296fe0c-7ec3-4bfb-a077-9c8a5d2e7783 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:28.838440 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-7296fe0c-7ec3-4bfb-a077-9c8a5d2e7783 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:28.975692 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-7296fe0c-7ec3-4bfb-a077-9c8a5d2e7783 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4fa4658a714288862f8a4d328f0f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6fe7a5a87c4740b32ee5e1cc1b7458', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:28.984634 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-7296fe0c-7ec3-4bfb-a077-9c8a5d2e7783 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] 10.222.0.59 "GET /compute/v2.1/servers/497588e0-f9a6-4c0b-9069-c4040b80cae6" status: 200 len: 1468 microversion: 2.1 time: 0.159167 Aug 26 00:57:28.985252 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 274/544] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:57:28 2022] GET /compute/v2.1/servers/497588e0-f9a6-4c0b-9069-c4040b80cae6 => generated 1468 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:57:29.263145 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-c02dfd77-b04b-4326-aebd-d79ce37fb4ba tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:57:29.263754 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-c02dfd77-b04b-4326-aebd-d79ce37fb4ba tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:57:29.270344 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c02dfd77-b04b-4326-aebd-d79ce37fb4ba tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:29.270824 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c02dfd77-b04b-4326-aebd-d79ce37fb4ba tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:29.271258 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c02dfd77-b04b-4326-aebd-d79ce37fb4ba tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:29.271942 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c02dfd77-b04b-4326-aebd-d79ce37fb4ba tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:29.272396 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c02dfd77-b04b-4326-aebd-d79ce37fb4ba tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:29.272850 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c02dfd77-b04b-4326-aebd-d79ce37fb4ba tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:29.403003 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-c02dfd77-b04b-4326-aebd-d79ce37fb4ba tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:29.412232 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-c02dfd77-b04b-4326-aebd-d79ce37fb4ba tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:29.413942 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-c02dfd77-b04b-4326-aebd-d79ce37fb4ba tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:29.415078 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-c02dfd77-b04b-4326-aebd-d79ce37fb4ba tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1808 microversion: 2.20 time: 0.155803 Aug 26 00:57:29.415631 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 271/545] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:57:29 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:57:30.006791 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-5ed6072a-9aad-4675-a861-7b36d26321da tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:57:30.007312 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-5ed6072a-9aad-4675-a861-7b36d26321da tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] [instance: 497588e0-f9a6-4c0b-9069-c4040b80cae6] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:57:30.013574 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5ed6072a-9aad-4675-a861-7b36d26321da tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:30.014063 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5ed6072a-9aad-4675-a861-7b36d26321da tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:30.014499 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5ed6072a-9aad-4675-a861-7b36d26321da tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:30.015195 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5ed6072a-9aad-4675-a861-7b36d26321da tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:30.016356 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5ed6072a-9aad-4675-a861-7b36d26321da tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:30.016803 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5ed6072a-9aad-4675-a861-7b36d26321da tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:30.143768 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-5ed6072a-9aad-4675-a861-7b36d26321da tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4fa4658a714288862f8a4d328f0f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6fe7a5a87c4740b32ee5e1cc1b7458', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:30.147135 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell1:SELECT=100 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:57:30.151614 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-5ed6072a-9aad-4675-a861-7b36d26321da tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] 10.222.0.59 "GET /compute/v2.1/servers/497588e0-f9a6-4c0b-9069-c4040b80cae6" status: 200 len: 1468 microversion: 2.1 time: 0.149437 Aug 26 00:57:30.152166 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 275/546] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:57:30 2022] GET /compute/v2.1/servers/497588e0-f9a6-4c0b-9069-c4040b80cae6 => generated 1468 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:57:30.438619 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-c225b17a-d138-4935-ad23-765d3422eb63 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:57:30.439197 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-c225b17a-d138-4935-ad23-765d3422eb63 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:57:30.445613 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c225b17a-d138-4935-ad23-765d3422eb63 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:30.446096 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c225b17a-d138-4935-ad23-765d3422eb63 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:30.446528 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c225b17a-d138-4935-ad23-765d3422eb63 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:30.447205 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c225b17a-d138-4935-ad23-765d3422eb63 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:30.447651 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c225b17a-d138-4935-ad23-765d3422eb63 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:30.448099 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c225b17a-d138-4935-ad23-765d3422eb63 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:30.465855 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:57:30.580025 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-c225b17a-d138-4935-ad23-765d3422eb63 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:30.588749 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-c225b17a-d138-4935-ad23-765d3422eb63 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:30.590184 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-c225b17a-d138-4935-ad23-765d3422eb63 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:30.591370 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-c225b17a-d138-4935-ad23-765d3422eb63 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1808 microversion: 2.20 time: 0.157333 Aug 26 00:57:30.591926 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 272/547] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:57:30 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:57:31.173267 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-827e602d-a635-400b-8398-6259e414192e tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:57:31.173920 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-827e602d-a635-400b-8398-6259e414192e tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] [instance: 497588e0-f9a6-4c0b-9069-c4040b80cae6] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:57:31.176272 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:57:31.181230 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-827e602d-a635-400b-8398-6259e414192e tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:31.181756 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-827e602d-a635-400b-8398-6259e414192e tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:31.182218 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-827e602d-a635-400b-8398-6259e414192e tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:31.182911 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-827e602d-a635-400b-8398-6259e414192e tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:31.183363 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-827e602d-a635-400b-8398-6259e414192e tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:31.183785 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-827e602d-a635-400b-8398-6259e414192e tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:31.315996 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-827e602d-a635-400b-8398-6259e414192e tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4fa4658a714288862f8a4d328f0f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6fe7a5a87c4740b32ee5e1cc1b7458', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:31.324222 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-827e602d-a635-400b-8398-6259e414192e tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] 10.222.0.59 "GET /compute/v2.1/servers/497588e0-f9a6-4c0b-9069-c4040b80cae6" status: 200 len: 1468 microversion: 2.1 time: 0.155459 Aug 26 00:57:31.324819 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 276/548] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:57:31 2022] GET /compute/v2.1/servers/497588e0-f9a6-4c0b-9069-c4040b80cae6 => generated 1468 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:57:31.614002 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-6ad7f426-d71f-4c54-ae6c-f1ebf7556546 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:57:31.614615 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-6ad7f426-d71f-4c54-ae6c-f1ebf7556546 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:57:31.621498 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6ad7f426-d71f-4c54-ae6c-f1ebf7556546 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:31.621976 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6ad7f426-d71f-4c54-ae6c-f1ebf7556546 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:31.622448 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6ad7f426-d71f-4c54-ae6c-f1ebf7556546 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:31.623124 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6ad7f426-d71f-4c54-ae6c-f1ebf7556546 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:31.623572 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6ad7f426-d71f-4c54-ae6c-f1ebf7556546 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:31.623990 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6ad7f426-d71f-4c54-ae6c-f1ebf7556546 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:31.754154 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-6ad7f426-d71f-4c54-ae6c-f1ebf7556546 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:31.763899 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-6ad7f426-d71f-4c54-ae6c-f1ebf7556546 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:31.766533 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-6ad7f426-d71f-4c54-ae6c-f1ebf7556546 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:31.768000 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-6ad7f426-d71f-4c54-ae6c-f1ebf7556546 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1795 microversion: 2.20 time: 0.157809 Aug 26 00:57:31.769965 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 273/549] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:57:31 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1795 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:57:32.346789 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-107396e1-5a02-47a0-91a6-8b57f6848d46 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:57:32.347509 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-107396e1-5a02-47a0-91a6-8b57f6848d46 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] [instance: 497588e0-f9a6-4c0b-9069-c4040b80cae6] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:57:32.353661 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-107396e1-5a02-47a0-91a6-8b57f6848d46 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:32.354182 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-107396e1-5a02-47a0-91a6-8b57f6848d46 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:32.354615 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-107396e1-5a02-47a0-91a6-8b57f6848d46 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:32.355301 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-107396e1-5a02-47a0-91a6-8b57f6848d46 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:32.355776 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-107396e1-5a02-47a0-91a6-8b57f6848d46 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:32.356340 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-107396e1-5a02-47a0-91a6-8b57f6848d46 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:32.538577 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-107396e1-5a02-47a0-91a6-8b57f6848d46 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4fa4658a714288862f8a4d328f0f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6fe7a5a87c4740b32ee5e1cc1b7458', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:32.547090 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-107396e1-5a02-47a0-91a6-8b57f6848d46 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] 10.222.0.59 "GET /compute/v2.1/servers/497588e0-f9a6-4c0b-9069-c4040b80cae6" status: 200 len: 1468 microversion: 2.1 time: 0.204153 Aug 26 00:57:32.547530 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 277/550] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:57:32 2022] GET /compute/v2.1/servers/497588e0-f9a6-4c0b-9069-c4040b80cae6 => generated 1468 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:57:32.709845 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [req-d57909d2-920c-41b9-bf8e-a24ea5ad49f1 req-db90824e-88e6-46f8-b9bf-a97b7ac6e0ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "497588e0-f9a6-4c0b-9069-c4040b80cae6", "name": "network-vif-deleted", "tag": "49428140-c8eb-4513-8f4c-d2fabf63552b"}]} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:57:32.720079 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-d57909d2-920c-41b9-bf8e-a24ea5ad49f1 req-db90824e-88e6-46f8-b9bf-a97b7ac6e0ed service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:32.721281 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-d57909d2-920c-41b9-bf8e-a24ea5ad49f1 req-db90824e-88e6-46f8-b9bf-a97b7ac6e0ed service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:32.721281 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-d57909d2-920c-41b9-bf8e-a24ea5ad49f1 req-db90824e-88e6-46f8-b9bf-a97b7ac6e0ed service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:32.733117 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.compute.server_external_events [req-d57909d2-920c-41b9-bf8e-a24ea5ad49f1 req-db90824e-88e6-46f8-b9bf-a97b7ac6e0ed service nova] Creating event network-vif-deleted:49428140-c8eb-4513-8f4c-d2fabf63552b for instance 497588e0-f9a6-4c0b-9069-c4040b80cae6 on hv-cinder-83538 Aug 26 00:57:32.738385 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [req-d57909d2-920c-41b9-bf8e-a24ea5ad49f1 req-db90824e-88e6-46f8-b9bf-a97b7ac6e0ed service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032192 Aug 26 00:57:32.738983 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 274/551] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 00:57:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:57:33.568700 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-da94609d-a102-4696-8544-0fcbdaa02a61 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:57:33.569346 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-da94609d-a102-4696-8544-0fcbdaa02a61 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] [instance: 497588e0-f9a6-4c0b-9069-c4040b80cae6] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:57:33.575400 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-da94609d-a102-4696-8544-0fcbdaa02a61 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:33.575879 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-da94609d-a102-4696-8544-0fcbdaa02a61 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:33.576313 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-da94609d-a102-4696-8544-0fcbdaa02a61 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:33.577039 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-da94609d-a102-4696-8544-0fcbdaa02a61 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:33.577496 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-da94609d-a102-4696-8544-0fcbdaa02a61 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:33.577920 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-da94609d-a102-4696-8544-0fcbdaa02a61 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:33.638928 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-da94609d-a102-4696-8544-0fcbdaa02a61 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4fa4658a714288862f8a4d328f0f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6fe7a5a87c4740b32ee5e1cc1b7458', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:33.646580 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-da94609d-a102-4696-8544-0fcbdaa02a61 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] 10.222.0.59 "GET /compute/v2.1/servers/497588e0-f9a6-4c0b-9069-c4040b80cae6" status: 200 len: 1426 microversion: 2.1 time: 0.081720 Aug 26 00:57:33.647258 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 278/552] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:57:33 2022] GET /compute/v2.1/servers/497588e0-f9a6-4c0b-9069-c4040b80cae6 => generated 1426 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:57:34.668958 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-eb0a9a39-7efe-464a-baed-8146130f928f tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:57:34.669563 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-eb0a9a39-7efe-464a-baed-8146130f928f tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] [instance: 497588e0-f9a6-4c0b-9069-c4040b80cae6] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:57:34.676599 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-eb0a9a39-7efe-464a-baed-8146130f928f tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:34.677079 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-eb0a9a39-7efe-464a-baed-8146130f928f tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:34.677504 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-eb0a9a39-7efe-464a-baed-8146130f928f tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:34.678186 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-eb0a9a39-7efe-464a-baed-8146130f928f tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:34.678664 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-eb0a9a39-7efe-464a-baed-8146130f928f tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:34.679078 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-eb0a9a39-7efe-464a-baed-8146130f928f tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:34.745887 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-eb0a9a39-7efe-464a-baed-8146130f928f tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4fa4658a714288862f8a4d328f0f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6fe7a5a87c4740b32ee5e1cc1b7458', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:34.754840 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-eb0a9a39-7efe-464a-baed-8146130f928f tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] 10.222.0.59 "GET /compute/v2.1/servers/497588e0-f9a6-4c0b-9069-c4040b80cae6" status: 200 len: 1426 microversion: 2.1 time: 0.091003 Aug 26 00:57:34.755407 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 275/553] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:57:34 2022] GET /compute/v2.1/servers/497588e0-f9a6-4c0b-9069-c4040b80cae6 => generated 1426 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:57:35.775637 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-554a979e-03a8-4409-beb3-1eeaa3a930d2 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:57:35.776182 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-554a979e-03a8-4409-beb3-1eeaa3a930d2 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] [instance: 497588e0-f9a6-4c0b-9069-c4040b80cae6] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:57:35.782133 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-554a979e-03a8-4409-beb3-1eeaa3a930d2 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:35.782609 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-554a979e-03a8-4409-beb3-1eeaa3a930d2 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:35.783038 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-554a979e-03a8-4409-beb3-1eeaa3a930d2 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:35.783730 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-554a979e-03a8-4409-beb3-1eeaa3a930d2 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:35.784177 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-554a979e-03a8-4409-beb3-1eeaa3a930d2 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:35.784630 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-554a979e-03a8-4409-beb3-1eeaa3a930d2 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:35.848774 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-554a979e-03a8-4409-beb3-1eeaa3a930d2 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4fa4658a714288862f8a4d328f0f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6fe7a5a87c4740b32ee5e1cc1b7458', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:57:35.856533 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-554a979e-03a8-4409-beb3-1eeaa3a930d2 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] 10.222.0.59 "GET /compute/v2.1/servers/497588e0-f9a6-4c0b-9069-c4040b80cae6" status: 200 len: 1298 microversion: 2.1 time: 0.084804 Aug 26 00:57:35.857189 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 279/554] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:57:35 2022] GET /compute/v2.1/servers/497588e0-f9a6-4c0b-9069-c4040b80cae6 => generated 1298 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:57:36.877922 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-56885d2e-ce9d-471f-8be3-1b876e228be5 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:57:36.878576 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-56885d2e-ce9d-471f-8be3-1b876e228be5 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] [instance: 497588e0-f9a6-4c0b-9069-c4040b80cae6] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:57:36.886305 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-56885d2e-ce9d-471f-8be3-1b876e228be5 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:36.886780 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-56885d2e-ce9d-471f-8be3-1b876e228be5 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:36.887211 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-56885d2e-ce9d-471f-8be3-1b876e228be5 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:36.887930 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-56885d2e-ce9d-471f-8be3-1b876e228be5 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:57:36.888374 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-56885d2e-ce9d-471f-8be3-1b876e228be5 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:57:36.888817 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-56885d2e-ce9d-471f-8be3-1b876e228be5 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:57:36.903462 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.wsgi [None req-56885d2e-ce9d-471f-8be3-1b876e228be5 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] HTTP exception thrown: Instance 497588e0-f9a6-4c0b-9069-c4040b80cae6 could not be found. Aug 26 00:57:36.905153 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-56885d2e-ce9d-471f-8be3-1b876e228be5 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Request method failure captured: Aug 26 00:57:36.905153 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: request: GET /compute/v2.1/servers/497588e0-f9a6-4c0b-9069-c4040b80cae6 HTTP/1.1 Aug 26 00:57:36.905153 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Accept: application/json Aug 26 00:57:36.905153 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Accept-Encoding: identity Aug 26 00:57:36.905153 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Connection: close Aug 26 00:57:36.905153 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Content-Length: 0 Aug 26 00:57:36.905153 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Content-Type: application/json Aug 26 00:57:36.905153 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Host: 10.222.0.59 Aug 26 00:57:36.905153 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Openstack-System-Scope: None Aug 26 00:57:36.905153 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: User-Agent: python-urllib3/1.26.11 Aug 26 00:57:36.905153 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Auth-Token: gAAAAABjCBpetsOTddRGzUKcpzU8THoCIZ3kCe5kbTDMM8Lqt96Ts6Kuy3UnCafsgTx9SY2bBi0019weehfDN9g2qovf5RGqV25RRfxtKR09FApTZPAj4p9ducrLanKdCedAs9NOkWz6n8p_xokREuKgcCOQq-WqlngcJ4XcobMLUoqpzstimiU Aug 26 00:57:36.905153 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Domain-Id: None Aug 26 00:57:36.905153 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Domain-Name: None Aug 26 00:57:36.905153 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Identity-Status: Confirmed Aug 26 00:57:36.905153 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Is-Admin-Project: True Aug 26 00:57:36.905153 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Domain-Id: default Aug 26 00:57:36.905153 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Domain-Name: Default Aug 26 00:57:36.905153 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Id: 7b6fe7a5a87c4740b32ee5e1cc1b7458 Aug 26 00:57:36.905153 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Name: tempest-VolumesNegativeTest-155643781 Aug 26 00:57:36.905153 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Role: reader,member Aug 26 00:57:36.905153 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Roles: reader,member Aug 26 00:57:36.907276 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_7b6fe7a5a87c4740b32ee5e1cc1b7458"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7b6fe7a5a87c4740b32ee5e1cc1b7458"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7b6fe7a5a87c4740b32ee5e1cc1b7458"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/7b6fe7a5a87c4740b32ee5e1cc1b7458"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 00:57:36.907276 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant: tempest-VolumesNegativeTest-155643781 Aug 26 00:57:36.907276 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant-Id: 7b6fe7a5a87c4740b32ee5e1cc1b7458 Aug 26 00:57:36.907276 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant-Name: tempest-VolumesNegativeTest-155643781 Aug 26 00:57:36.907276 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User: tempest-VolumesNegativeTest-155643781-project Aug 26 00:57:36.907276 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Domain-Id: default Aug 26 00:57:36.907276 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Domain-Name: Default Aug 26 00:57:36.907276 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Id: 5c4fa4658a714288862f8a4d328f0f9c Aug 26 00:57:36.907276 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Name: tempest-VolumesNegativeTest-155643781-project Aug 26 00:57:36.907276 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: method: > Aug 26 00:57:36.907276 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: exception: Instance 497588e0-f9a6-4c0b-9069-c4040b80cae6 could not be found. Aug 26 00:57:36.907276 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: action_args: {'id': '497588e0-f9a6-4c0b-9069-c4040b80cae6'} Aug 26 00:57:36.908631 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 00:57:36.908631 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:57:36.908631 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 00:57:36.908631 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 00:57:36.908631 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 00:57:36.908631 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 00:57:36.908631 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 00:57:36.908631 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 00:57:36.908631 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 00:57:36.908631 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 00:57:36.908631 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 497588e0-f9a6-4c0b-9069-c4040b80cae6 could not be found. Aug 26 00:57:36.908631 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:57:36.908631 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 00:57:36.908631 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:57:36.908631 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:57:36.908631 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 00:57:36.908631 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 00:57:36.908631 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 00:57:36.908631 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 00:57:36.908631 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 00:57:36.912074 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 00:57:36.912074 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 00:57:36.912074 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 00:57:36.912074 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 00:57:36.912074 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 00:57:36.912074 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 00:57:36.912074 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 00:57:36.912074 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 497588e0-f9a6-4c0b-9069-c4040b80cae6 could not be found. Aug 26 00:57:36.912074 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:57:36.912074 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 00:57:36.912074 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:57:36.912074 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:57:36.912074 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 00:57:36.912074 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 00:57:36.912074 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 00:57:36.912074 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 00:57:36.912074 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 497588e0-f9a6-4c0b-9069-c4040b80cae6 could not be found. Aug 26 00:57:36.912074 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:57:36.914900 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-56885d2e-ce9d-471f-8be3-1b876e228be5 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] Returning 404 to user: Instance 497588e0-f9a6-4c0b-9069-c4040b80cae6 could not be found. {{(pid=127565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 00:57:36.914900 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-56885d2e-ce9d-471f-8be3-1b876e228be5 tempest-VolumesNegativeTest-155643781 tempest-VolumesNegativeTest-155643781-project] 10.222.0.59 "GET /compute/v2.1/servers/497588e0-f9a6-4c0b-9069-c4040b80cae6" status: 404 len: 111 microversion: 2.1 time: 0.033302 Aug 26 00:57:36.914900 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 276/555] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:57:36 2022] GET /compute/v2.1/servers/497588e0-f9a6-4c0b-9069-c4040b80cae6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 00:58:03.627539 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-d0d9bfad-abd8-4e09-8a24-a8df5310a781 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:03.628135 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-d0d9bfad-abd8-4e09-8a24-a8df5310a781 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:03.630408 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_api:SELECT=7 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:03.631075 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell1:SELECT=24 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:03.635830 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-d0d9bfad-abd8-4e09-8a24-a8df5310a781 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:03.636376 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-d0d9bfad-abd8-4e09-8a24-a8df5310a781 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:03.636968 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-d0d9bfad-abd8-4e09-8a24-a8df5310a781 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:03.637696 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-d0d9bfad-abd8-4e09-8a24-a8df5310a781 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:03.638202 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-d0d9bfad-abd8-4e09-8a24-a8df5310a781 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:03.638632 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-d0d9bfad-abd8-4e09-8a24-a8df5310a781 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:03.764013 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.objects.instance [None req-d0d9bfad-abd8-4e09-8a24-a8df5310a781 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lazy-loading 'services' on Instance uuid 730816fc-0c43-43e3-ab6e-e7f324e403d7 {{(pid=127564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 00:58:04.046598 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-d0d9bfad-abd8-4e09-8a24-a8df5310a781 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "DELETE /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7/os-volume_attachments/3c73d394-1112-4228-bd36-317f2c2e3363" status: 202 len: 0 microversion: 2.1 time: 0.423653 Aug 26 00:58:04.047188 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 280/556] 10.222.0.59 () {58 vars in 1416 bytes} [Fri Aug 26 00:58:03 2022] DELETE /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7/os-volume_attachments/3c73d394-1112-4228-bd36-317f2c2e3363 => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 00:58:06.076443 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-9356d5f7-38a9-4d86-a6b4-dc55da4d3270 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "40d6b3f6-fcb9-43af-acbd-fff8f85abb20"}} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:58:06.078841 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-9356d5f7-38a9-4d86-a6b4-dc55da4d3270 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:06.081362 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:06.082015 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell1:SELECT=18 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:06.086775 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9356d5f7-38a9-4d86-a6b4-dc55da4d3270 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:06.087261 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9356d5f7-38a9-4d86-a6b4-dc55da4d3270 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:06.087740 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9356d5f7-38a9-4d86-a6b4-dc55da4d3270 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:06.100096 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9356d5f7-38a9-4d86-a6b4-dc55da4d3270 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:06.100096 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9356d5f7-38a9-4d86-a6b4-dc55da4d3270 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:06.100096 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9356d5f7-38a9-4d86-a6b4-dc55da4d3270 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:06.225990 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-8700fefa-58e3-4caa-b7f7-809271d4d64b tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:58:06.232752 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8700fefa-58e3-4caa-b7f7-809271d4d64b tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:06.233235 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8700fefa-58e3-4caa-b7f7-809271d4d64b tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:06.233670 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8700fefa-58e3-4caa-b7f7-809271d4d64b tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:06.255231 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-8700fefa-58e3-4caa-b7f7-809271d4d64b tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Going to try to stop instance {{(pid=127564) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 26 00:58:06.466893 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-8700fefa-58e3-4caa-b7f7-809271d4d64b tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "POST /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7/action" status: 202 len: 0 microversion: 2.1 time: 0.244811 Aug 26 00:58:06.467516 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 281/557] 10.222.0.59 () {60 vars in 1278 bytes} [Fri Aug 26 00:58:06 2022] POST /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 26 00:58:06.475835 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-1830175e-2a20-4e88-bb69-3649079c090c tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:06.476600 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-1830175e-2a20-4e88-bb69-3649079c090c tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:06.483211 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1830175e-2a20-4e88-bb69-3649079c090c tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:06.483694 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1830175e-2a20-4e88-bb69-3649079c090c tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:06.484179 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1830175e-2a20-4e88-bb69-3649079c090c tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:06.485029 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1830175e-2a20-4e88-bb69-3649079c090c tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:06.485485 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1830175e-2a20-4e88-bb69-3649079c090c tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:06.485914 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1830175e-2a20-4e88-bb69-3649079c090c tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:06.627375 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-1830175e-2a20-4e88-bb69-3649079c090c tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:06.636042 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-1830175e-2a20-4e88-bb69-3649079c090c tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1675 microversion: 2.1 time: 0.164075 Aug 26 00:58:06.637092 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 282/558] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:58:06 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1675 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:58:06.885297 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-9356d5f7-38a9-4d86-a6b4-dc55da4d3270 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "POST /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.812628 Aug 26 00:58:06.885958 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 277/559] 10.222.0.59 () {60 vars in 1323 bytes} [Fri Aug 26 00:58:06 2022] POST /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd/os-volume_attachments => generated 194 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:58:07.658752 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-9d07697a-a4ed-4fc4-8080-77f036df1f8f tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:07.659379 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-9d07697a-a4ed-4fc4-8080-77f036df1f8f tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:07.665660 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9d07697a-a4ed-4fc4-8080-77f036df1f8f tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:07.666161 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9d07697a-a4ed-4fc4-8080-77f036df1f8f tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:07.666600 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9d07697a-a4ed-4fc4-8080-77f036df1f8f tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:07.667288 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9d07697a-a4ed-4fc4-8080-77f036df1f8f tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:07.667740 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9d07697a-a4ed-4fc4-8080-77f036df1f8f tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:07.668163 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9d07697a-a4ed-4fc4-8080-77f036df1f8f tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:07.796312 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-9d07697a-a4ed-4fc4-8080-77f036df1f8f tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:07.804116 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-9d07697a-a4ed-4fc4-8080-77f036df1f8f tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1675 microversion: 2.1 time: 0.149179 Aug 26 00:58:07.804719 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 283/560] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:58:07 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1675 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:58:08.827181 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-9f540fe2-898e-42c6-aa68-b31df79db155 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:08.827872 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-9f540fe2-898e-42c6-aa68-b31df79db155 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:08.834052 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9f540fe2-898e-42c6-aa68-b31df79db155 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:08.834532 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9f540fe2-898e-42c6-aa68-b31df79db155 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:08.834969 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9f540fe2-898e-42c6-aa68-b31df79db155 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:08.835649 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9f540fe2-898e-42c6-aa68-b31df79db155 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:08.836095 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9f540fe2-898e-42c6-aa68-b31df79db155 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:08.836536 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9f540fe2-898e-42c6-aa68-b31df79db155 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:08.964866 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-9f540fe2-898e-42c6-aa68-b31df79db155 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:08.972622 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-9f540fe2-898e-42c6-aa68-b31df79db155 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1675 microversion: 2.1 time: 0.150631 Aug 26 00:58:08.973182 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 278/561] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:58:08 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:58:09.993294 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-1c3974b5-c0d1-4bf7-ac86-380032b3078d tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:09.993944 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-1c3974b5-c0d1-4bf7-ac86-380032b3078d tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:09.999985 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1c3974b5-c0d1-4bf7-ac86-380032b3078d tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:10.000461 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1c3974b5-c0d1-4bf7-ac86-380032b3078d tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:10.000925 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1c3974b5-c0d1-4bf7-ac86-380032b3078d tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:10.001606 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1c3974b5-c0d1-4bf7-ac86-380032b3078d tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:10.002058 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1c3974b5-c0d1-4bf7-ac86-380032b3078d tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:10.002481 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1c3974b5-c0d1-4bf7-ac86-380032b3078d tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:10.128660 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-1c3974b5-c0d1-4bf7-ac86-380032b3078d tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:10.136207 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-1c3974b5-c0d1-4bf7-ac86-380032b3078d tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1675 microversion: 2.1 time: 0.146729 Aug 26 00:58:10.136804 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 284/562] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:58:09 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1675 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:58:11.160407 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-bb22a96f-00ae-4911-a331-2ca0e0501966 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:11.160980 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-bb22a96f-00ae-4911-a331-2ca0e0501966 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:11.167983 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-bb22a96f-00ae-4911-a331-2ca0e0501966 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:11.168486 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-bb22a96f-00ae-4911-a331-2ca0e0501966 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:11.168936 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-bb22a96f-00ae-4911-a331-2ca0e0501966 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:11.169633 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-bb22a96f-00ae-4911-a331-2ca0e0501966 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:11.170087 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-bb22a96f-00ae-4911-a331-2ca0e0501966 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:11.170510 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-bb22a96f-00ae-4911-a331-2ca0e0501966 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:11.300409 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-bb22a96f-00ae-4911-a331-2ca0e0501966 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:11.308042 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-bb22a96f-00ae-4911-a331-2ca0e0501966 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1675 microversion: 2.1 time: 0.154422 Aug 26 00:58:11.308634 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 279/563] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:58:11 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:58:12.328341 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-709fc70e-583e-417c-98d3-915698c3c3c6 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:12.328980 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-709fc70e-583e-417c-98d3-915698c3c3c6 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:12.334909 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-709fc70e-583e-417c-98d3-915698c3c3c6 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:12.335394 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-709fc70e-583e-417c-98d3-915698c3c3c6 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:12.335825 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-709fc70e-583e-417c-98d3-915698c3c3c6 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:12.336547 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-709fc70e-583e-417c-98d3-915698c3c3c6 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:12.337002 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-709fc70e-583e-417c-98d3-915698c3c3c6 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:12.337456 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-709fc70e-583e-417c-98d3-915698c3c3c6 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:12.467903 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-709fc70e-583e-417c-98d3-915698c3c3c6 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:12.475640 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-709fc70e-583e-417c-98d3-915698c3c3c6 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1675 microversion: 2.1 time: 0.151079 Aug 26 00:58:12.477533 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 285/564] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:58:12 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:58:13.324737 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-91c30629-90d2-41f4-9da3-c8efc91f43ae tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:13.325305 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-91c30629-90d2-41f4-9da3-c8efc91f43ae tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:13.331560 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-91c30629-90d2-41f4-9da3-c8efc91f43ae tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:13.335410 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-91c30629-90d2-41f4-9da3-c8efc91f43ae tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:13.335410 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-91c30629-90d2-41f4-9da3-c8efc91f43ae tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:13.335410 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-91c30629-90d2-41f4-9da3-c8efc91f43ae tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:13.335410 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-91c30629-90d2-41f4-9da3-c8efc91f43ae tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:13.335879 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-91c30629-90d2-41f4-9da3-c8efc91f43ae tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:13.365167 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-91c30629-90d2-41f4-9da3-c8efc91f43ae tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b/os-volume_attachments/1eb8e79c-aa18-45e4-9491-8e4e0a406185" status: 200 len: 194 microversion: 2.20 time: 0.044954 Aug 26 00:58:13.365761 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 280/565] 10.222.0.59 () {60 vars in 1454 bytes} [Fri Aug 26 00:58:13 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b/os-volume_attachments/1eb8e79c-aa18-45e4-9491-8e4e0a406185 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 00:58:13.434296 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-5518d854-9017-4937-ba0a-0aff6ddaaadb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:13.434805 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-5518d854-9017-4937-ba0a-0aff6ddaaadb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:13.440808 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5518d854-9017-4937-ba0a-0aff6ddaaadb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:13.441286 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5518d854-9017-4937-ba0a-0aff6ddaaadb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:13.441721 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5518d854-9017-4937-ba0a-0aff6ddaaadb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:13.442408 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5518d854-9017-4937-ba0a-0aff6ddaaadb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:13.442860 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5518d854-9017-4937-ba0a-0aff6ddaaadb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:13.443281 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5518d854-9017-4937-ba0a-0aff6ddaaadb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:13.496968 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-9b6d836c-3193-4409-ad80-0b149a162304 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:13.497603 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-9b6d836c-3193-4409-ad80-0b149a162304 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:13.503468 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9b6d836c-3193-4409-ad80-0b149a162304 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:13.503944 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9b6d836c-3193-4409-ad80-0b149a162304 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:13.504376 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9b6d836c-3193-4409-ad80-0b149a162304 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:13.505078 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9b6d836c-3193-4409-ad80-0b149a162304 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:13.505519 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9b6d836c-3193-4409-ad80-0b149a162304 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:13.505935 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9b6d836c-3193-4409-ad80-0b149a162304 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:13.524335 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.objects.instance [None req-5518d854-9017-4937-ba0a-0aff6ddaaadb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lazy-loading 'services' on Instance uuid 7502d0cf-4abc-484b-8c85-d8ea6682333b {{(pid=127564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 00:58:13.638090 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-9b6d836c-3193-4409-ad80-0b149a162304 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:13.645866 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-9b6d836c-3193-4409-ad80-0b149a162304 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1675 microversion: 2.1 time: 0.152752 Aug 26 00:58:13.646430 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 281/566] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:58:13 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:58:13.771389 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-5518d854-9017-4937-ba0a-0aff6ddaaadb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "DELETE /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b/os-volume_attachments/1eb8e79c-aa18-45e4-9491-8e4e0a406185" status: 202 len: 0 microversion: 2.20 time: 0.340780 Aug 26 00:58:13.774296 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 286/567] 10.222.0.59 () {60 vars in 1457 bytes} [Fri Aug 26 00:58:13 2022] DELETE /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b/os-volume_attachments/1eb8e79c-aa18-45e4-9491-8e4e0a406185 => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 26 00:58:13.781905 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-25cff658-5673-46eb-9c2a-86c63f207a22 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:13.784256 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-25cff658-5673-46eb-9c2a-86c63f207a22 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:13.790449 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-25cff658-5673-46eb-9c2a-86c63f207a22 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:13.790934 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-25cff658-5673-46eb-9c2a-86c63f207a22 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:13.791476 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-25cff658-5673-46eb-9c2a-86c63f207a22 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:13.792734 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-25cff658-5673-46eb-9c2a-86c63f207a22 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:13.793222 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-25cff658-5673-46eb-9c2a-86c63f207a22 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:13.793644 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-25cff658-5673-46eb-9c2a-86c63f207a22 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:13.823847 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-25cff658-5673-46eb-9c2a-86c63f207a22 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046990 Aug 26 00:58:13.824406 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 282/568] 10.222.0.59 () {60 vars in 1343 bytes} [Fri Aug 26 00:58:13 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 26 00:58:14.668058 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-d5ff4431-79f1-4964-9fb7-66c9ce9615d8 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:14.668693 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-d5ff4431-79f1-4964-9fb7-66c9ce9615d8 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:14.674843 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-d5ff4431-79f1-4964-9fb7-66c9ce9615d8 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:14.675313 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-d5ff4431-79f1-4964-9fb7-66c9ce9615d8 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:14.675738 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-d5ff4431-79f1-4964-9fb7-66c9ce9615d8 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:14.676437 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-d5ff4431-79f1-4964-9fb7-66c9ce9615d8 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:14.676905 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-d5ff4431-79f1-4964-9fb7-66c9ce9615d8 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:14.677321 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-d5ff4431-79f1-4964-9fb7-66c9ce9615d8 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:14.806201 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-d5ff4431-79f1-4964-9fb7-66c9ce9615d8 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:14.814551 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-d5ff4431-79f1-4964-9fb7-66c9ce9615d8 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1675 microversion: 2.1 time: 0.150993 Aug 26 00:58:14.815112 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 287/569] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:58:14 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:58:14.837719 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-3a010adf-67e2-40a0-98a7-43fd10637c8a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:14.841268 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-3a010adf-67e2-40a0-98a7-43fd10637c8a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:14.847877 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3a010adf-67e2-40a0-98a7-43fd10637c8a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:14.850109 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3a010adf-67e2-40a0-98a7-43fd10637c8a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:14.850109 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3a010adf-67e2-40a0-98a7-43fd10637c8a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:14.850479 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3a010adf-67e2-40a0-98a7-43fd10637c8a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:14.850939 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3a010adf-67e2-40a0-98a7-43fd10637c8a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:14.851767 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3a010adf-67e2-40a0-98a7-43fd10637c8a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:14.882322 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-3a010adf-67e2-40a0-98a7-43fd10637c8a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050534 Aug 26 00:58:14.882921 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 283/570] 10.222.0.59 () {60 vars in 1343 bytes} [Fri Aug 26 00:58:14 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 00:58:15.470155 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-8f308d18-098b-4291-98c0-028a9ca8b3a3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:58:15.472450 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-8f308d18-098b-4291-98c0-028a9ca8b3a3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:15.478456 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8f308d18-098b-4291-98c0-028a9ca8b3a3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:15.483113 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8f308d18-098b-4291-98c0-028a9ca8b3a3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:15.483113 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8f308d18-098b-4291-98c0-028a9ca8b3a3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:15.483113 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8f308d18-098b-4291-98c0-028a9ca8b3a3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:15.483113 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8f308d18-098b-4291-98c0-028a9ca8b3a3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:15.483519 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8f308d18-098b-4291-98c0-028a9ca8b3a3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:15.505423 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.objects.instance [None req-8f308d18-098b-4291-98c0-028a9ca8b3a3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lazy-loading 'flavor' on Instance uuid 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd {{(pid=127564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 00:58:15.835601 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-d4b7b3ba-c23c-4332-b72c-5413b57ce46b tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:15.836222 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-d4b7b3ba-c23c-4332-b72c-5413b57ce46b tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:15.839796 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-8f308d18-098b-4291-98c0-028a9ca8b3a3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "POST /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd/action" status: 200 len: 32 microversion: 2.1 time: 0.372526 Aug 26 00:58:15.853120 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 288/571] 10.222.0.59 () {60 vars in 1278 bytes} [Fri Aug 26 00:58:15 2022] POST /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd/action => generated 32 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 00:58:15.853286 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d4b7b3ba-c23c-4332-b72c-5413b57ce46b tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:15.853286 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d4b7b3ba-c23c-4332-b72c-5413b57ce46b tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:15.853286 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d4b7b3ba-c23c-4332-b72c-5413b57ce46b tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:15.853286 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d4b7b3ba-c23c-4332-b72c-5413b57ce46b tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:15.854014 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d4b7b3ba-c23c-4332-b72c-5413b57ce46b tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:15.854014 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d4b7b3ba-c23c-4332-b72c-5413b57ce46b tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:15.854155 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-8be051a6-8ec2-428b-819d-ba5de0a0f9fc tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:15.854155 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-8be051a6-8ec2-428b-819d-ba5de0a0f9fc tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:15.859621 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8be051a6-8ec2-428b-819d-ba5de0a0f9fc tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:15.860113 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8be051a6-8ec2-428b-819d-ba5de0a0f9fc tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:15.860583 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8be051a6-8ec2-428b-819d-ba5de0a0f9fc tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:15.861291 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8be051a6-8ec2-428b-819d-ba5de0a0f9fc tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:15.861877 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8be051a6-8ec2-428b-819d-ba5de0a0f9fc tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:15.862464 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8be051a6-8ec2-428b-819d-ba5de0a0f9fc tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:15.988404 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-d4b7b3ba-c23c-4332-b72c-5413b57ce46b tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:15.997824 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-d4b7b3ba-c23c-4332-b72c-5413b57ce46b tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1675 microversion: 2.1 time: 0.166073 Aug 26 00:58:15.998405 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 284/572] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:58:15 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1675 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:58:16.002983 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-8fd1d90d-9de5-4289-9f07-c0fefcdc4624 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:16.005277 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-8fd1d90d-9de5-4289-9f07-c0fefcdc4624 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:16.011207 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8fd1d90d-9de5-4289-9f07-c0fefcdc4624 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:16.011576 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8fd1d90d-9de5-4289-9f07-c0fefcdc4624 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:16.012037 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8fd1d90d-9de5-4289-9f07-c0fefcdc4624 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:16.012778 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8fd1d90d-9de5-4289-9f07-c0fefcdc4624 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:16.013220 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8fd1d90d-9de5-4289-9f07-c0fefcdc4624 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:16.013647 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8fd1d90d-9de5-4289-9f07-c0fefcdc4624 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:16.045160 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-8fd1d90d-9de5-4289-9f07-c0fefcdc4624 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045706 Aug 26 00:58:16.045721 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 285/573] 10.222.0.59 () {60 vars in 1343 bytes} [Fri Aug 26 00:58:15 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:58:16.088822 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-8be051a6-8ec2-428b-819d-ba5de0a0f9fc tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:16.100824 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-8be051a6-8ec2-428b-819d-ba5de0a0f9fc tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd" status: 200 len: 1737 microversion: 2.1 time: 0.249595 Aug 26 00:58:16.100824 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 289/574] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:58:15 2022] GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd => generated 1737 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:58:16.110758 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-7a54b0bd-d951-454a-aa5c-fd9c987ca28c tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:16.111253 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-7a54b0bd-d951-454a-aa5c-fd9c987ca28c tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:16.117272 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7a54b0bd-d951-454a-aa5c-fd9c987ca28c tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:16.125351 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7a54b0bd-d951-454a-aa5c-fd9c987ca28c tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:16.125351 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7a54b0bd-d951-454a-aa5c-fd9c987ca28c tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:16.125351 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7a54b0bd-d951-454a-aa5c-fd9c987ca28c tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:16.125351 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7a54b0bd-d951-454a-aa5c-fd9c987ca28c tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:16.125775 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7a54b0bd-d951-454a-aa5c-fd9c987ca28c tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:16.144612 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-7a54b0bd-d951-454a-aa5c-fd9c987ca28c tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Going to try to terminate instance {{(pid=127565) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 00:58:16.423451 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-7a54b0bd-d951-454a-aa5c-fd9c987ca28c tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "DELETE /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 204 len: 0 microversion: 2.20 time: 0.316225 Aug 26 00:58:16.424043 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 286/575] 10.222.0.59 () {60 vars in 1280 bytes} [Fri Aug 26 00:58:16 2022] DELETE /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 26 00:58:16.432450 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-257c9126-9846-4dd3-b5fa-2ce210146042 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:16.433331 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-257c9126-9846-4dd3-b5fa-2ce210146042 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:16.440113 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-257c9126-9846-4dd3-b5fa-2ce210146042 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:16.440710 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-257c9126-9846-4dd3-b5fa-2ce210146042 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:16.441152 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-257c9126-9846-4dd3-b5fa-2ce210146042 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:16.441849 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-257c9126-9846-4dd3-b5fa-2ce210146042 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:16.442302 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-257c9126-9846-4dd3-b5fa-2ce210146042 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:16.442730 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-257c9126-9846-4dd3-b5fa-2ce210146042 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:16.575805 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-257c9126-9846-4dd3-b5fa-2ce210146042 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:16.584127 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-257c9126-9846-4dd3-b5fa-2ce210146042 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:16.585622 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-257c9126-9846-4dd3-b5fa-2ce210146042 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:16.589408 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-257c9126-9846-4dd3-b5fa-2ce210146042 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1723 microversion: 2.20 time: 0.158329 Aug 26 00:58:16.589408 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 290/576] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:58:16 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:58:17.019640 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-e1cdad6e-f672-4dd7-b8d7-22719b1eb680 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:17.020367 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-e1cdad6e-f672-4dd7-b8d7-22719b1eb680 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:17.027427 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e1cdad6e-f672-4dd7-b8d7-22719b1eb680 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:17.027908 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e1cdad6e-f672-4dd7-b8d7-22719b1eb680 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:17.028346 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e1cdad6e-f672-4dd7-b8d7-22719b1eb680 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:17.029058 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e1cdad6e-f672-4dd7-b8d7-22719b1eb680 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:17.029508 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e1cdad6e-f672-4dd7-b8d7-22719b1eb680 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:17.029930 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e1cdad6e-f672-4dd7-b8d7-22719b1eb680 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:17.116961 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-a310c690-9da1-4543-8169-980683248bdc tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:17.117671 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-a310c690-9da1-4543-8169-980683248bdc tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:17.123343 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a310c690-9da1-4543-8169-980683248bdc tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:17.123818 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a310c690-9da1-4543-8169-980683248bdc tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:17.124248 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a310c690-9da1-4543-8169-980683248bdc tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:17.124967 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a310c690-9da1-4543-8169-980683248bdc tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:17.125412 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a310c690-9da1-4543-8169-980683248bdc tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:17.125826 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a310c690-9da1-4543-8169-980683248bdc tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:17.157372 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-e1cdad6e-f672-4dd7-b8d7-22719b1eb680 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:17.165485 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-e1cdad6e-f672-4dd7-b8d7-22719b1eb680 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1675 microversion: 2.1 time: 0.150058 Aug 26 00:58:17.166042 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 287/577] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:58:17 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:58:17.255436 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-a310c690-9da1-4543-8169-980683248bdc tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:17.264103 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-a310c690-9da1-4543-8169-980683248bdc tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd" status: 200 len: 1737 microversion: 2.1 time: 0.150836 Aug 26 00:58:17.264691 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 291/578] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:58:17 2022] GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:58:17.610000 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-9477eb16-f43b-42cb-9fd9-7c9154e77bde tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:17.610603 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-9477eb16-f43b-42cb-9fd9-7c9154e77bde tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:17.616676 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9477eb16-f43b-42cb-9fd9-7c9154e77bde tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:17.617155 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9477eb16-f43b-42cb-9fd9-7c9154e77bde tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:17.617588 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9477eb16-f43b-42cb-9fd9-7c9154e77bde tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:17.618268 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9477eb16-f43b-42cb-9fd9-7c9154e77bde tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:17.618715 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9477eb16-f43b-42cb-9fd9-7c9154e77bde tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:17.619134 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9477eb16-f43b-42cb-9fd9-7c9154e77bde tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:17.766762 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-9477eb16-f43b-42cb-9fd9-7c9154e77bde tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:17.778081 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-9477eb16-f43b-42cb-9fd9-7c9154e77bde tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:17.779504 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-9477eb16-f43b-42cb-9fd9-7c9154e77bde tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:17.780719 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-9477eb16-f43b-42cb-9fd9-7c9154e77bde tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1723 microversion: 2.20 time: 0.174703 Aug 26 00:58:17.781304 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 288/579] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:58:17 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:58:18.186292 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-65b86681-dc39-4366-b1d2-07bdea7e4c51 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:18.186904 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-65b86681-dc39-4366-b1d2-07bdea7e4c51 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:18.193123 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-65b86681-dc39-4366-b1d2-07bdea7e4c51 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:18.193612 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-65b86681-dc39-4366-b1d2-07bdea7e4c51 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:18.194052 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-65b86681-dc39-4366-b1d2-07bdea7e4c51 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:18.194751 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-65b86681-dc39-4366-b1d2-07bdea7e4c51 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:18.195207 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-65b86681-dc39-4366-b1d2-07bdea7e4c51 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:18.195636 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-65b86681-dc39-4366-b1d2-07bdea7e4c51 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:18.200613 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=4,nova_cell1:UPDATE=3 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:18.285548 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-d2b6bb1b-d06e-474d-ad42-29f75fede051 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:18.286288 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-d2b6bb1b-d06e-474d-ad42-29f75fede051 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:18.293866 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d2b6bb1b-d06e-474d-ad42-29f75fede051 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:18.294345 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d2b6bb1b-d06e-474d-ad42-29f75fede051 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:18.294772 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d2b6bb1b-d06e-474d-ad42-29f75fede051 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:18.295460 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d2b6bb1b-d06e-474d-ad42-29f75fede051 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:18.295901 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d2b6bb1b-d06e-474d-ad42-29f75fede051 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:18.296376 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d2b6bb1b-d06e-474d-ad42-29f75fede051 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:18.374442 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-65b86681-dc39-4366-b1d2-07bdea7e4c51 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:18.383325 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-65b86681-dc39-4366-b1d2-07bdea7e4c51 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1652 microversion: 2.1 time: 0.199956 Aug 26 00:58:18.387835 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 292/580] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:58:18 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1652 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:58:18.405511 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-ef240134-5794-43bb-a830-cdce4309d361 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:58:18.415105 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ef240134-5794-43bb-a830-cdce4309d361 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:18.415691 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ef240134-5794-43bb-a830-cdce4309d361 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:18.416197 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ef240134-5794-43bb-a830-cdce4309d361 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:18.440767 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-ef240134-5794-43bb-a830-cdce4309d361 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Going to try to start instance {{(pid=127564) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 26 00:58:18.444261 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-d2b6bb1b-d06e-474d-ad42-29f75fede051 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:18.453692 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-d2b6bb1b-d06e-474d-ad42-29f75fede051 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd" status: 200 len: 1737 microversion: 2.1 time: 0.171840 Aug 26 00:58:18.454480 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 289/581] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:58:18 2022] GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd => generated 1737 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:58:18.657421 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-ef240134-5794-43bb-a830-cdce4309d361 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "POST /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7/action" status: 202 len: 0 microversion: 2.1 time: 0.256360 Aug 26 00:58:18.658065 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 293/582] 10.222.0.59 () {60 vars in 1278 bytes} [Fri Aug 26 00:58:18 2022] POST /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 26 00:58:18.667518 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-e32a9ae2-9842-475c-bd5d-b7af256cc1be tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:18.668133 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-e32a9ae2-9842-475c-bd5d-b7af256cc1be tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:18.675000 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e32a9ae2-9842-475c-bd5d-b7af256cc1be tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:18.675487 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e32a9ae2-9842-475c-bd5d-b7af256cc1be tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:18.675921 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e32a9ae2-9842-475c-bd5d-b7af256cc1be tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:18.676641 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e32a9ae2-9842-475c-bd5d-b7af256cc1be tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:18.677090 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e32a9ae2-9842-475c-bd5d-b7af256cc1be tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:18.677512 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e32a9ae2-9842-475c-bd5d-b7af256cc1be tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:18.697355 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:18.806604 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-e4d82f0d-9557-4d0c-a833-2ed2e45ab5de tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:18.807440 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-e4d82f0d-9557-4d0c-a833-2ed2e45ab5de tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:18.815745 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e4d82f0d-9557-4d0c-a833-2ed2e45ab5de tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:18.816508 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e4d82f0d-9557-4d0c-a833-2ed2e45ab5de tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:18.817192 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e4d82f0d-9557-4d0c-a833-2ed2e45ab5de tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:18.817618 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e4d82f0d-9557-4d0c-a833-2ed2e45ab5de tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:18.818066 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e4d82f0d-9557-4d0c-a833-2ed2e45ab5de tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:18.818484 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e4d82f0d-9557-4d0c-a833-2ed2e45ab5de tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:18.821722 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-e32a9ae2-9842-475c-bd5d-b7af256cc1be tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:18.832427 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-e32a9ae2-9842-475c-bd5d-b7af256cc1be tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1661 microversion: 2.1 time: 0.168970 Aug 26 00:58:18.833730 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 290/583] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:58:18 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1661 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:58:19.037464 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-e4d82f0d-9557-4d0c-a833-2ed2e45ab5de tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:19.051413 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-e4d82f0d-9557-4d0c-a833-2ed2e45ab5de tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:19.052958 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-e4d82f0d-9557-4d0c-a833-2ed2e45ab5de tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:19.054220 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-e4d82f0d-9557-4d0c-a833-2ed2e45ab5de tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1723 microversion: 2.20 time: 0.253592 Aug 26 00:58:19.054772 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 294/584] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:58:18 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1723 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 00:58:19.443646 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [req-c62e10fe-2421-4ad7-9d19-fd6f88cadadf req-27d57663-d98e-4f25-98bb-2b3d9d082661 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7502d0cf-4abc-484b-8c85-d8ea6682333b", "name": "network-vif-deleted", "tag": "ee6ad2fb-f57e-474d-a46b-a0d19ae36479"}]} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:58:19.458696 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-c62e10fe-2421-4ad7-9d19-fd6f88cadadf req-27d57663-d98e-4f25-98bb-2b3d9d082661 service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:19.459505 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-c62e10fe-2421-4ad7-9d19-fd6f88cadadf req-27d57663-d98e-4f25-98bb-2b3d9d082661 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:19.460123 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-c62e10fe-2421-4ad7-9d19-fd6f88cadadf req-27d57663-d98e-4f25-98bb-2b3d9d082661 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:19.472739 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.compute.server_external_events [req-c62e10fe-2421-4ad7-9d19-fd6f88cadadf req-27d57663-d98e-4f25-98bb-2b3d9d082661 service nova] Creating event network-vif-deleted:ee6ad2fb-f57e-474d-a46b-a0d19ae36479 for instance 7502d0cf-4abc-484b-8c85-d8ea6682333b on hv-cinder-83538 Aug 26 00:58:19.481548 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-464ab561-974b-4420-a6f1-f22e72c1586d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:19.482359 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [req-c62e10fe-2421-4ad7-9d19-fd6f88cadadf req-27d57663-d98e-4f25-98bb-2b3d9d082661 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043123 Aug 26 00:58:19.482807 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-464ab561-974b-4420-a6f1-f22e72c1586d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:19.483314 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 291/585] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 00:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:58:19.491348 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-464ab561-974b-4420-a6f1-f22e72c1586d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:19.491843 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-464ab561-974b-4420-a6f1-f22e72c1586d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:19.492347 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-464ab561-974b-4420-a6f1-f22e72c1586d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:19.493101 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-464ab561-974b-4420-a6f1-f22e72c1586d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:19.493555 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-464ab561-974b-4420-a6f1-f22e72c1586d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:19.493982 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-464ab561-974b-4420-a6f1-f22e72c1586d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:19.675703 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-464ab561-974b-4420-a6f1-f22e72c1586d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:19.685913 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-464ab561-974b-4420-a6f1-f22e72c1586d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd" status: 200 len: 1737 microversion: 2.1 time: 0.211585 Aug 26 00:58:19.686688 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 295/586] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:58:19 2022] GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd => generated 1737 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:58:19.855501 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-f7c19ffd-24f7-4b3b-813e-1e780533bf76 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:19.856195 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-f7c19ffd-24f7-4b3b-813e-1e780533bf76 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:19.862550 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f7c19ffd-24f7-4b3b-813e-1e780533bf76 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:19.863027 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f7c19ffd-24f7-4b3b-813e-1e780533bf76 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:19.863481 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f7c19ffd-24f7-4b3b-813e-1e780533bf76 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:19.864159 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f7c19ffd-24f7-4b3b-813e-1e780533bf76 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:19.864636 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f7c19ffd-24f7-4b3b-813e-1e780533bf76 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:19.865051 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f7c19ffd-24f7-4b3b-813e-1e780533bf76 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:20.026870 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-f7c19ffd-24f7-4b3b-813e-1e780533bf76 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:20.035898 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-f7c19ffd-24f7-4b3b-813e-1e780533bf76 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1661 microversion: 2.1 time: 0.185182 Aug 26 00:58:20.049728 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 292/587] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:58:19 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1661 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:58:20.077965 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-e3e26788-8d00-493c-b362-17de4c09ed9f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:20.078582 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-e3e26788-8d00-493c-b362-17de4c09ed9f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:20.084758 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e3e26788-8d00-493c-b362-17de4c09ed9f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:20.085251 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e3e26788-8d00-493c-b362-17de4c09ed9f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:20.085685 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e3e26788-8d00-493c-b362-17de4c09ed9f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:20.086375 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e3e26788-8d00-493c-b362-17de4c09ed9f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:20.087013 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e3e26788-8d00-493c-b362-17de4c09ed9f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:20.087447 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e3e26788-8d00-493c-b362-17de4c09ed9f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:20.134689 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e3e26788-8d00-493c-b362-17de4c09ed9f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:20.135177 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e3e26788-8d00-493c-b362-17de4c09ed9f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:20.135638 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e3e26788-8d00-493c-b362-17de4c09ed9f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:20.136122 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.objects.instance [None req-e3e26788-8d00-493c-b362-17de4c09ed9f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lazy-loading 'fault' on Instance uuid 7502d0cf-4abc-484b-8c85-d8ea6682333b {{(pid=127564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 00:58:20.180249 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-e3e26788-8d00-493c-b362-17de4c09ed9f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:20.189840 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-e3e26788-8d00-493c-b362-17de4c09ed9f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:20.191373 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-e3e26788-8d00-493c-b362-17de4c09ed9f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:20.192619 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-e3e26788-8d00-493c-b362-17de4c09ed9f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1370 microversion: 2.20 time: 0.118833 Aug 26 00:58:20.193567 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 296/588] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:58:20 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1370 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:58:20.719061 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-bec3c47a-cf96-4cda-85b6-4928943a703c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:20.731138 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-bec3c47a-cf96-4cda-85b6-4928943a703c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:20.755964 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-bec3c47a-cf96-4cda-85b6-4928943a703c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:20.756857 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-bec3c47a-cf96-4cda-85b6-4928943a703c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:20.757642 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-bec3c47a-cf96-4cda-85b6-4928943a703c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:20.758880 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-bec3c47a-cf96-4cda-85b6-4928943a703c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:20.765051 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-bec3c47a-cf96-4cda-85b6-4928943a703c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:20.765891 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-bec3c47a-cf96-4cda-85b6-4928943a703c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:20.937252 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-bec3c47a-cf96-4cda-85b6-4928943a703c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:20.948105 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-bec3c47a-cf96-4cda-85b6-4928943a703c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd" status: 200 len: 1737 microversion: 2.1 time: 0.244181 Aug 26 00:58:20.949081 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 293/589] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:58:20 2022] GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd => generated 1737 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:58:21.058415 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-9945605b-6efd-4a19-a18a-f970dc2713ff tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:21.059946 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-9945605b-6efd-4a19-a18a-f970dc2713ff tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:21.066426 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9945605b-6efd-4a19-a18a-f970dc2713ff tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:21.066932 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9945605b-6efd-4a19-a18a-f970dc2713ff tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:21.067593 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9945605b-6efd-4a19-a18a-f970dc2713ff tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:21.068297 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9945605b-6efd-4a19-a18a-f970dc2713ff tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:21.068818 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9945605b-6efd-4a19-a18a-f970dc2713ff tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:21.069237 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9945605b-6efd-4a19-a18a-f970dc2713ff tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:21.199894 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-9945605b-6efd-4a19-a18a-f970dc2713ff tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:21.209210 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-9945605b-6efd-4a19-a18a-f970dc2713ff tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1665 microversion: 2.1 time: 0.154782 Aug 26 00:58:21.209830 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 297/590] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:58:21 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1665 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:58:21.216169 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-66a95630-e71c-4893-9a88-4551b0e98664 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:21.216806 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-66a95630-e71c-4893-9a88-4551b0e98664 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:21.223249 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-66a95630-e71c-4893-9a88-4551b0e98664 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:21.223743 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-66a95630-e71c-4893-9a88-4551b0e98664 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:21.224180 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-66a95630-e71c-4893-9a88-4551b0e98664 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:21.224910 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-66a95630-e71c-4893-9a88-4551b0e98664 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:21.225362 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-66a95630-e71c-4893-9a88-4551b0e98664 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:21.225792 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-66a95630-e71c-4893-9a88-4551b0e98664 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:21.259272 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-66a95630-e71c-4893-9a88-4551b0e98664 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:21.259750 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-66a95630-e71c-4893-9a88-4551b0e98664 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:21.260184 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-66a95630-e71c-4893-9a88-4551b0e98664 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:21.260674 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.objects.instance [None req-66a95630-e71c-4893-9a88-4551b0e98664 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lazy-loading 'fault' on Instance uuid 7502d0cf-4abc-484b-8c85-d8ea6682333b {{(pid=127565) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 00:58:21.304296 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-66a95630-e71c-4893-9a88-4551b0e98664 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:21.313999 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-66a95630-e71c-4893-9a88-4551b0e98664 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:21.315450 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-66a95630-e71c-4893-9a88-4551b0e98664 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:21.316646 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-66a95630-e71c-4893-9a88-4551b0e98664 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 200 len: 1370 microversion: 2.20 time: 0.105190 Aug 26 00:58:21.317205 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 294/591] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:58:21 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 1370 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:58:21.969765 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-3ca752d0-3ef0-48da-85d2-d35285d50bb9 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:21.970290 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-3ca752d0-3ef0-48da-85d2-d35285d50bb9 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:21.977041 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3ca752d0-3ef0-48da-85d2-d35285d50bb9 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:21.977559 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3ca752d0-3ef0-48da-85d2-d35285d50bb9 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:21.977988 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3ca752d0-3ef0-48da-85d2-d35285d50bb9 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:21.978686 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3ca752d0-3ef0-48da-85d2-d35285d50bb9 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:21.979139 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3ca752d0-3ef0-48da-85d2-d35285d50bb9 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:21.980370 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3ca752d0-3ef0-48da-85d2-d35285d50bb9 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:22.111222 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-3ca752d0-3ef0-48da-85d2-d35285d50bb9 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:22.119390 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-3ca752d0-3ef0-48da-85d2-d35285d50bb9 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd" status: 200 len: 1737 microversion: 2.1 time: 0.153638 Aug 26 00:58:22.119974 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 298/592] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:58:21 2022] GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:58:22.341113 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-9b9a2d64-1320-4681-a621-c2ff72ea697f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:22.341818 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-9b9a2d64-1320-4681-a621-c2ff72ea697f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:22.347695 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9b9a2d64-1320-4681-a621-c2ff72ea697f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:22.348185 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9b9a2d64-1320-4681-a621-c2ff72ea697f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:22.348643 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9b9a2d64-1320-4681-a621-c2ff72ea697f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:22.349328 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9b9a2d64-1320-4681-a621-c2ff72ea697f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:22.349776 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9b9a2d64-1320-4681-a621-c2ff72ea697f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:22.350195 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9b9a2d64-1320-4681-a621-c2ff72ea697f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:22.363685 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.wsgi [None req-9b9a2d64-1320-4681-a621-c2ff72ea697f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] HTTP exception thrown: Instance 7502d0cf-4abc-484b-8c85-d8ea6682333b could not be found. Aug 26 00:58:22.365352 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-9b9a2d64-1320-4681-a621-c2ff72ea697f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Request method failure captured: Aug 26 00:58:22.365352 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: request: GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b HTTP/1.1 Aug 26 00:58:22.365352 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Accept: application/json Aug 26 00:58:22.365352 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Accept-Encoding: identity Aug 26 00:58:22.365352 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Connection: close Aug 26 00:58:22.365352 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Content-Length: 0 Aug 26 00:58:22.365352 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Content-Type: application/json Aug 26 00:58:22.365352 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Host: 10.222.0.59 Aug 26 00:58:22.365352 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Openstack-System-Scope: None Aug 26 00:58:22.365352 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: User-Agent: python-urllib3/1.26.11 Aug 26 00:58:22.365352 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Auth-Token: gAAAAABjCBmgyDDgilWQYDV3Pt1Em3kTCxsE41M0vbwJrr1Rqja-DMZaIcX5WNaG7FxAXeyifEVBYFh6_R904f-XKGQt3qooDi2aWUs0Asz3CfbSPUljnbPhu8WqCIlc-fkFdpvaLdAPObY8uyEVhiLqyDKxGxdz6WKuxtkKvk5v_G0Cg36QQHc Aug 26 00:58:22.365352 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Domain-Id: None Aug 26 00:58:22.365352 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Domain-Name: None Aug 26 00:58:22.365352 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Identity-Status: Confirmed Aug 26 00:58:22.365352 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Is-Admin-Project: True Aug 26 00:58:22.365352 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Openstack-Nova-Api-Version: 2.20 Aug 26 00:58:22.365352 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Domain-Id: default Aug 26 00:58:22.365352 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Domain-Name: Default Aug 26 00:58:22.365352 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Id: ec39c32378ac4017ad50aa6f930e514b Aug 26 00:58:22.365352 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-700972569 Aug 26 00:58:22.365352 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Role: reader,member Aug 26 00:58:22.365352 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Roles: reader,member Aug 26 00:58:22.366973 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ec39c32378ac4017ad50aa6f930e514b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ec39c32378ac4017ad50aa6f930e514b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ec39c32378ac4017ad50aa6f930e514b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ec39c32378ac4017ad50aa6f930e514b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 00:58:22.366973 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant: tempest-AttachVolumeShelveTestJSON-700972569 Aug 26 00:58:22.366973 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant-Id: ec39c32378ac4017ad50aa6f930e514b Aug 26 00:58:22.366973 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-700972569 Aug 26 00:58:22.366973 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User: tempest-AttachVolumeShelveTestJSON-700972569-project Aug 26 00:58:22.366973 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Domain-Id: default Aug 26 00:58:22.366973 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Domain-Name: Default Aug 26 00:58:22.366973 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Id: 34240c306dc54f0c8758dbb4b4525376 Aug 26 00:58:22.366973 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Name: tempest-AttachVolumeShelveTestJSON-700972569-project Aug 26 00:58:22.366973 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: method: > Aug 26 00:58:22.366973 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: exception: Instance 7502d0cf-4abc-484b-8c85-d8ea6682333b could not be found. Aug 26 00:58:22.366973 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: action_args: {'id': '7502d0cf-4abc-484b-8c85-d8ea6682333b'} Aug 26 00:58:22.367909 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 00:58:22.367909 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:58:22.367909 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 00:58:22.367909 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 00:58:22.367909 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 00:58:22.367909 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 00:58:22.367909 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 00:58:22.367909 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 00:58:22.367909 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 00:58:22.367909 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 00:58:22.367909 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7502d0cf-4abc-484b-8c85-d8ea6682333b could not be found. Aug 26 00:58:22.367909 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:58:22.367909 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 00:58:22.367909 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:58:22.367909 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:58:22.367909 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 00:58:22.367909 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 00:58:22.367909 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 00:58:22.367909 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 00:58:22.367909 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 00:58:22.369573 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 00:58:22.369573 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 00:58:22.369573 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 00:58:22.369573 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 00:58:22.369573 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 00:58:22.369573 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 00:58:22.369573 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 00:58:22.369573 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7502d0cf-4abc-484b-8c85-d8ea6682333b could not be found. Aug 26 00:58:22.369573 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:58:22.369573 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 00:58:22.369573 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:58:22.369573 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:58:22.369573 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 00:58:22.369573 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 00:58:22.369573 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 00:58:22.369573 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 00:58:22.369573 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7502d0cf-4abc-484b-8c85-d8ea6682333b could not be found. Aug 26 00:58:22.369573 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:58:22.370851 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-9b9a2d64-1320-4681-a621-c2ff72ea697f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Returning 404 to user: Instance 7502d0cf-4abc-484b-8c85-d8ea6682333b could not be found. {{(pid=127565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 00:58:22.370851 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-9b9a2d64-1320-4681-a621-c2ff72ea697f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 404 len: 111 microversion: 2.20 time: 0.030665 Aug 26 00:58:22.370851 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 295/593] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:58:22 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 26 00:58:22.377217 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-5d308ca2-f902-43d5-a86c-c248b950ab89 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '.version_select at 0x7f8a92e2d940>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:22.381836 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5d308ca2-f902-43d5-a86c-c248b950ab89 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [e906880e-402c-40f8-bdad-5a76167473ed] AMQP server on 10.222.0.59:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 26 00:58:23.140024 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-8cf23a25-470d-4a5b-8150-48509bc70843 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:23.140647 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-8cf23a25-470d-4a5b-8150-48509bc70843 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:23.146686 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8cf23a25-470d-4a5b-8150-48509bc70843 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:23.147187 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8cf23a25-470d-4a5b-8150-48509bc70843 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:23.147614 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8cf23a25-470d-4a5b-8150-48509bc70843 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:23.148290 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8cf23a25-470d-4a5b-8150-48509bc70843 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:23.148760 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8cf23a25-470d-4a5b-8150-48509bc70843 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:23.149177 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8cf23a25-470d-4a5b-8150-48509bc70843 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:23.291119 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-8cf23a25-470d-4a5b-8150-48509bc70843 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:23.300125 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-8cf23a25-470d-4a5b-8150-48509bc70843 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd" status: 200 len: 1737 microversion: 2.1 time: 0.163933 Aug 26 00:58:23.300713 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 296/594] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:58:23 2022] GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:58:23.388608 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO oslo.messaging._drivers.impl_rabbit [None req-5d308ca2-f902-43d5-a86c-c248b950ab89 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [e906880e-402c-40f8-bdad-5a76167473ed] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 57338. Aug 26 00:58:23.465787 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-5d308ca2-f902-43d5-a86c-c248b950ab89 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1127667667" status: 204 len: 0 microversion: 2.20 time: 1.093640 Aug 26 00:58:23.466636 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 299/595] 10.222.0.59 () {60 vars in 1262 bytes} [Fri Aug 26 00:58:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1127667667 => generated 0 bytes in 1095 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 26 00:58:24.223205 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-612cdfb1-1446-46fa-b89f-de26b5728dbf tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Action: 'create', calling method: .version_select at 0x7f8a92dac4c0>, body: {"keypair": {"name": "tempest-keypair-197231024", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNa5oY9j+7eo5MwQIL77+wQ5wLFOCkappY2tnduWQueUCeqN6V9gi2jLdzLhAP7vR1uQNvy0EHPE4/8ler+jH/5JJIbFMV/HbW6PvXyfYyr3cHPnU/EGwY9z2jd7oP/iCQ=="}} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:58:24.239079 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.quota [None req-612cdfb1-1446-46fa-b89f-de26b5728dbf tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Getting quotas for project ec39c32378ac4017ad50aa6f930e514b. Resources: {'key_pairs'} {{(pid=127565) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 00:58:24.242924 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.quota [None req-612cdfb1-1446-46fa-b89f-de26b5728dbf tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Getting quotas for user 34240c306dc54f0c8758dbb4b4525376 and project ec39c32378ac4017ad50aa6f930e514b. Resources: {'key_pairs'} {{(pid=127565) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 00:58:24.321907 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-612cdfb1-1446-46fa-b89f-de26b5728dbf tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.102689 Aug 26 00:58:24.322503 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 297/596] 10.222.0.59 () {62 vars in 1200 bytes} [Fri Aug 26 00:58:24 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 104 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 26 00:58:24.322794 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-32accfe8-8f3c-45c0-98aa-f2d9189eadd4 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:24.323412 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-32accfe8-8f3c-45c0-98aa-f2d9189eadd4 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:24.330978 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-32accfe8-8f3c-45c0-98aa-f2d9189eadd4 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:24.331420 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-32accfe8-8f3c-45c0-98aa-f2d9189eadd4 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:24.331866 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-32accfe8-8f3c-45c0-98aa-f2d9189eadd4 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:24.332604 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-32accfe8-8f3c-45c0-98aa-f2d9189eadd4 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:24.333066 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-32accfe8-8f3c-45c0-98aa-f2d9189eadd4 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:24.333495 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-32accfe8-8f3c-45c0-98aa-f2d9189eadd4 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:24.466863 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-32accfe8-8f3c-45c0-98aa-f2d9189eadd4 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:24.475432 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-32accfe8-8f3c-45c0-98aa-f2d9189eadd4 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd" status: 200 len: 1737 microversion: 2.1 time: 0.156914 Aug 26 00:58:24.476014 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 300/597] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:58:24 2022] GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:58:25.499131 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-d7f09017-dabf-496d-8aae-0c6723c14fbe tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:25.499745 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-d7f09017-dabf-496d-8aae-0c6723c14fbe tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:25.507064 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d7f09017-dabf-496d-8aae-0c6723c14fbe tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:25.507545 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d7f09017-dabf-496d-8aae-0c6723c14fbe tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:25.507981 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d7f09017-dabf-496d-8aae-0c6723c14fbe tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:25.508698 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d7f09017-dabf-496d-8aae-0c6723c14fbe tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:25.509147 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d7f09017-dabf-496d-8aae-0c6723c14fbe tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:25.509577 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d7f09017-dabf-496d-8aae-0c6723c14fbe tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:25.647082 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-d7f09017-dabf-496d-8aae-0c6723c14fbe tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:25.656398 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-d7f09017-dabf-496d-8aae-0c6723c14fbe tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd" status: 200 len: 1737 microversion: 2.1 time: 0.162298 Aug 26 00:58:25.657019 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 298/598] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:58:25 2022] GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:58:26.679282 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-6f2e2a78-1db8-4bb0-8566-bb2a1103b6a3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:26.679880 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-6f2e2a78-1db8-4bb0-8566-bb2a1103b6a3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:26.686346 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6f2e2a78-1db8-4bb0-8566-bb2a1103b6a3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:26.686824 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6f2e2a78-1db8-4bb0-8566-bb2a1103b6a3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:26.687254 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6f2e2a78-1db8-4bb0-8566-bb2a1103b6a3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:26.687937 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6f2e2a78-1db8-4bb0-8566-bb2a1103b6a3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:26.688381 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6f2e2a78-1db8-4bb0-8566-bb2a1103b6a3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:26.688832 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6f2e2a78-1db8-4bb0-8566-bb2a1103b6a3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:26.737745 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-c20876af-c2dc-4cff-b074-a1e869e5e366 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-999084116", "imageRef": "ef60327f-6e0c-4f85-8db9-6f6e8968fe9c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "82719f0d-e147-413c-83ac-404aae47d6de"}], "security_groups": [{"name": "tempest-securitygroup--472926306"}], "key_name": "tempest-keypair-197231024", "user_data": "}} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:58:26.826523 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-6f2e2a78-1db8-4bb0-8566-bb2a1103b6a3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:26.834946 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-6f2e2a78-1db8-4bb0-8566-bb2a1103b6a3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd" status: 200 len: 1737 microversion: 2.1 time: 0.159412 Aug 26 00:58:26.835531 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 301/599] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:58:26 2022] GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:58:26.846250 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.network.neutron [None req-c20876af-c2dc-4cff-b074-a1e869e5e366 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] validate_networks() for [('82719f0d-e147-413c-83ac-404aae47d6de', None, None, None, None, None)] {{(pid=127565) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 00:58:27.225048 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.virt.hardware [None req-c20876af-c2dc-4cff-b074-a1e869e5e366 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Flavor limits 0:0:0 {{(pid=127565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 00:58:27.225505 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.virt.hardware [None req-c20876af-c2dc-4cff-b074-a1e869e5e366 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Image limits 0:0:0 {{(pid=127565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 00:58:27.226006 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.virt.hardware [None req-c20876af-c2dc-4cff-b074-a1e869e5e366 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Flavor pref 0:0:0 {{(pid=127565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 00:58:27.226415 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.virt.hardware [None req-c20876af-c2dc-4cff-b074-a1e869e5e366 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Image pref 0:0:0 {{(pid=127565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 00:58:27.226827 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.virt.hardware [None req-c20876af-c2dc-4cff-b074-a1e869e5e366 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 00:58:27.235852 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c20876af-c2dc-4cff-b074-a1e869e5e366 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:27.236331 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c20876af-c2dc-4cff-b074-a1e869e5e366 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:27.236802 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c20876af-c2dc-4cff-b074-a1e869e5e366 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:27.237523 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c20876af-c2dc-4cff-b074-a1e869e5e366 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:27.237976 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c20876af-c2dc-4cff-b074-a1e869e5e366 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:27.238400 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c20876af-c2dc-4cff-b074-a1e869e5e366 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:27.255553 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.quota [None req-c20876af-c2dc-4cff-b074-a1e869e5e366 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Getting quotas for project ec39c32378ac4017ad50aa6f930e514b. Resources: {'instances', 'ram', 'cores'} {{(pid=127565) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 00:58:27.259515 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.quota [None req-c20876af-c2dc-4cff-b074-a1e869e5e366 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Getting quotas for user 34240c306dc54f0c8758dbb4b4525376 and project ec39c32378ac4017ad50aa6f930e514b. Resources: {'instances', 'ram', 'cores'} {{(pid=127565) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 00:58:27.271168 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-c20876af-c2dc-4cff-b074-a1e869e5e366 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Going to run 1 instances... {{(pid=127565) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 00:58:27.273467 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-c20876af-c2dc-4cff-b074-a1e869e5e366 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ef60327f-6e0c-4f85-8db9-6f6e8968fe9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127565) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 00:58:27.420380 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-c20876af-c2dc-4cff-b074-a1e869e5e366 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.686795 Aug 26 00:58:27.421073 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 299/600] 10.222.0.59 () {62 vars in 1188 bytes} [Fri Aug 26 00:58:26 2022] POST /compute/v2.1/servers => generated 401 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 26 00:58:27.431806 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-8c3571b6-2f90-448a-83da-de897387442e tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:27.432974 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-8c3571b6-2f90-448a-83da-de897387442e tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:27.486958 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-8c3571b6-2f90-448a-83da-de897387442e tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:27.494331 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-8c3571b6-2f90-448a-83da-de897387442e tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:27.496488 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-8c3571b6-2f90-448a-83da-de897387442e tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:27.502783 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-8c3571b6-2f90-448a-83da-de897387442e tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 200 len: 1280 microversion: 2.20 time: 0.069738 Aug 26 00:58:27.502783 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 302/601] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:58:27 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 1280 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:58:27.857163 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-49ed7b4d-6245-4c97-b3a0-11a3e30796ad tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:27.857777 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-49ed7b4d-6245-4c97-b3a0-11a3e30796ad tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:27.865271 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-49ed7b4d-6245-4c97-b3a0-11a3e30796ad tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:27.865752 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-49ed7b4d-6245-4c97-b3a0-11a3e30796ad tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:27.866189 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-49ed7b4d-6245-4c97-b3a0-11a3e30796ad tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:27.866975 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-49ed7b4d-6245-4c97-b3a0-11a3e30796ad tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:27.867430 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-49ed7b4d-6245-4c97-b3a0-11a3e30796ad tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:27.867854 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-49ed7b4d-6245-4c97-b3a0-11a3e30796ad tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:27.997190 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-49ed7b4d-6245-4c97-b3a0-11a3e30796ad tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:28.005538 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-49ed7b4d-6245-4c97-b3a0-11a3e30796ad tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd" status: 200 len: 1737 microversion: 2.1 time: 0.152964 Aug 26 00:58:28.006099 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 300/602] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:58:27 2022] GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:58:28.519851 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-46d61786-b774-4191-a3b3-217525aaced0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:28.520499 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-46d61786-b774-4191-a3b3-217525aaced0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:28.526797 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-46d61786-b774-4191-a3b3-217525aaced0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:28.527283 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-46d61786-b774-4191-a3b3-217525aaced0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:28.527710 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-46d61786-b774-4191-a3b3-217525aaced0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:28.528394 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-46d61786-b774-4191-a3b3-217525aaced0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:28.528875 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-46d61786-b774-4191-a3b3-217525aaced0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:28.529295 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-46d61786-b774-4191-a3b3-217525aaced0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:28.591350 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-46d61786-b774-4191-a3b3-217525aaced0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:28.601536 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-46d61786-b774-4191-a3b3-217525aaced0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:28.602974 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-46d61786-b774-4191-a3b3-217525aaced0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:28.604934 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-46d61786-b774-4191-a3b3-217525aaced0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 200 len: 1284 microversion: 2.20 time: 0.088323 Aug 26 00:58:28.605941 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 303/603] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:58:28 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 1284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:58:29.026274 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-f17af92f-bb73-4e86-ae0f-9b4fa8859088 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:29.027064 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-f17af92f-bb73-4e86-ae0f-9b4fa8859088 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:29.035141 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f17af92f-bb73-4e86-ae0f-9b4fa8859088 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:29.038009 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f17af92f-bb73-4e86-ae0f-9b4fa8859088 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:29.038009 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f17af92f-bb73-4e86-ae0f-9b4fa8859088 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:29.038009 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f17af92f-bb73-4e86-ae0f-9b4fa8859088 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:29.038009 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f17af92f-bb73-4e86-ae0f-9b4fa8859088 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:29.038437 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f17af92f-bb73-4e86-ae0f-9b4fa8859088 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:29.173645 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-f17af92f-bb73-4e86-ae0f-9b4fa8859088 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:29.182099 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-f17af92f-bb73-4e86-ae0f-9b4fa8859088 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd" status: 200 len: 1737 microversion: 2.1 time: 0.159679 Aug 26 00:58:29.182661 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 301/604] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:58:29 2022] GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:58:29.627762 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-685746dd-74fd-4803-b287-ff8e72a8820e tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:29.628414 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-685746dd-74fd-4803-b287-ff8e72a8820e tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:29.634804 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-685746dd-74fd-4803-b287-ff8e72a8820e tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:29.635294 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-685746dd-74fd-4803-b287-ff8e72a8820e tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:29.635730 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-685746dd-74fd-4803-b287-ff8e72a8820e tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:29.636426 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-685746dd-74fd-4803-b287-ff8e72a8820e tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:29.637619 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-685746dd-74fd-4803-b287-ff8e72a8820e tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:29.638092 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-685746dd-74fd-4803-b287-ff8e72a8820e tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:29.706399 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-685746dd-74fd-4803-b287-ff8e72a8820e tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:29.714216 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-685746dd-74fd-4803-b287-ff8e72a8820e tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:29.715637 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-685746dd-74fd-4803-b287-ff8e72a8820e tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:29.716783 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-685746dd-74fd-4803-b287-ff8e72a8820e tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 200 len: 1340 microversion: 2.20 time: 0.092979 Aug 26 00:58:29.717347 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 304/605] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:58:29 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 1340 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 00:58:30.203461 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-48814485-15f2-4406-ad70-404d18a051d1 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:30.204115 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-48814485-15f2-4406-ad70-404d18a051d1 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:30.210725 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-48814485-15f2-4406-ad70-404d18a051d1 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:30.211213 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-48814485-15f2-4406-ad70-404d18a051d1 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:30.211649 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-48814485-15f2-4406-ad70-404d18a051d1 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:30.212477 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-48814485-15f2-4406-ad70-404d18a051d1 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:30.212955 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-48814485-15f2-4406-ad70-404d18a051d1 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:30.213379 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-48814485-15f2-4406-ad70-404d18a051d1 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:30.431583 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-48814485-15f2-4406-ad70-404d18a051d1 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:30.442641 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-48814485-15f2-4406-ad70-404d18a051d1 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd" status: 200 len: 1737 microversion: 2.1 time: 0.243098 Aug 26 00:58:30.443237 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 302/606] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:58:30 2022] GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd => generated 1737 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:58:30.742978 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-f339273e-4ac6-480f-9e85-d6467a1b7e76 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:30.743499 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-f339273e-4ac6-480f-9e85-d6467a1b7e76 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:30.749279 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f339273e-4ac6-480f-9e85-d6467a1b7e76 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:30.749760 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f339273e-4ac6-480f-9e85-d6467a1b7e76 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:30.750194 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f339273e-4ac6-480f-9e85-d6467a1b7e76 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:30.750879 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f339273e-4ac6-480f-9e85-d6467a1b7e76 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:30.751327 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f339273e-4ac6-480f-9e85-d6467a1b7e76 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:30.751744 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f339273e-4ac6-480f-9e85-d6467a1b7e76 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:30.879592 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-f339273e-4ac6-480f-9e85-d6467a1b7e76 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:30.888620 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-f339273e-4ac6-480f-9e85-d6467a1b7e76 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:30.890060 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-f339273e-4ac6-480f-9e85-d6467a1b7e76 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:30.891165 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-f339273e-4ac6-480f-9e85-d6467a1b7e76 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 200 len: 1405 microversion: 2.20 time: 0.152260 Aug 26 00:58:30.891719 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 305/607] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:58:30 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 1405 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:58:31.247893 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [req-3105b8cf-1449-47f0-b115-f2cb1e56e988 req-e1b19f94-7c0e-45e4-8679-ef2197bb24ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8af18a63-5c10-4530-9072-6ca92223b8ec", "tag": "abc8d4e4-fe47-4480-9cbb-c4ca4d73b355"}]} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:58:31.258690 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-3105b8cf-1449-47f0-b115-f2cb1e56e988 req-e1b19f94-7c0e-45e4-8679-ef2197bb24ff service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:31.259255 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-3105b8cf-1449-47f0-b115-f2cb1e56e988 req-e1b19f94-7c0e-45e4-8679-ef2197bb24ff service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:31.259696 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-3105b8cf-1449-47f0-b115-f2cb1e56e988 req-e1b19f94-7c0e-45e4-8679-ef2197bb24ff service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:31.270764 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.compute.server_external_events [req-3105b8cf-1449-47f0-b115-f2cb1e56e988 req-e1b19f94-7c0e-45e4-8679-ef2197bb24ff service nova] Creating event network-changed:abc8d4e4-fe47-4480-9cbb-c4ca4d73b355 for instance 8af18a63-5c10-4530-9072-6ca92223b8ec on hv-cinder-83538 Aug 26 00:58:31.276280 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [req-3105b8cf-1449-47f0-b115-f2cb1e56e988 req-e1b19f94-7c0e-45e4-8679-ef2197bb24ff service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033210 Aug 26 00:58:31.276905 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 303/608] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 00:58:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:58:31.464391 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-45e353d0-7c76-430a-b1fa-c02a6c706a13 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:31.464966 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-45e353d0-7c76-430a-b1fa-c02a6c706a13 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:31.470864 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-45e353d0-7c76-430a-b1fa-c02a6c706a13 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:31.471351 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-45e353d0-7c76-430a-b1fa-c02a6c706a13 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:31.474528 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-45e353d0-7c76-430a-b1fa-c02a6c706a13 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:31.474528 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-45e353d0-7c76-430a-b1fa-c02a6c706a13 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:31.474528 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-45e353d0-7c76-430a-b1fa-c02a6c706a13 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:31.474528 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-45e353d0-7c76-430a-b1fa-c02a6c706a13 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:31.606520 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-45e353d0-7c76-430a-b1fa-c02a6c706a13 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:31.614783 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-45e353d0-7c76-430a-b1fa-c02a6c706a13 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd" status: 200 len: 1737 microversion: 2.1 time: 0.154271 Aug 26 00:58:31.615353 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 306/609] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:58:31 2022] GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:58:31.915315 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-117acf12-d61c-46a9-9652-7e170d0198da tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:31.916014 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-117acf12-d61c-46a9-9652-7e170d0198da tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:31.923261 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-117acf12-d61c-46a9-9652-7e170d0198da tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:31.923734 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-117acf12-d61c-46a9-9652-7e170d0198da tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:31.924291 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-117acf12-d61c-46a9-9652-7e170d0198da tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:31.925064 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-117acf12-d61c-46a9-9652-7e170d0198da tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:31.925511 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-117acf12-d61c-46a9-9652-7e170d0198da tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:31.925951 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-117acf12-d61c-46a9-9652-7e170d0198da tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:32.125677 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-117acf12-d61c-46a9-9652-7e170d0198da tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:32.134049 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-117acf12-d61c-46a9-9652-7e170d0198da tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:32.135522 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-117acf12-d61c-46a9-9652-7e170d0198da tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:32.137197 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-117acf12-d61c-46a9-9652-7e170d0198da tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 200 len: 1405 microversion: 2.20 time: 0.225868 Aug 26 00:58:32.137870 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 304/610] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:58:31 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 1405 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:58:32.635704 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-c003e80d-a60b-4e53-84c8-d4c357595ef8 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:32.636243 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-c003e80d-a60b-4e53-84c8-d4c357595ef8 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:32.642927 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c003e80d-a60b-4e53-84c8-d4c357595ef8 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:32.643408 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c003e80d-a60b-4e53-84c8-d4c357595ef8 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:32.643838 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c003e80d-a60b-4e53-84c8-d4c357595ef8 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:32.644545 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c003e80d-a60b-4e53-84c8-d4c357595ef8 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:32.644997 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c003e80d-a60b-4e53-84c8-d4c357595ef8 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:32.645420 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c003e80d-a60b-4e53-84c8-d4c357595ef8 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:32.773435 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-c003e80d-a60b-4e53-84c8-d4c357595ef8 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:32.782223 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-c003e80d-a60b-4e53-84c8-d4c357595ef8 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd" status: 200 len: 1737 microversion: 2.1 time: 0.150477 Aug 26 00:58:32.782780 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 307/611] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:58:32 2022] GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:58:33.159250 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-d63c3b54-9c40-4c4d-8d1f-3f3d35061b57 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:33.159870 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-d63c3b54-9c40-4c4d-8d1f-3f3d35061b57 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:33.166994 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d63c3b54-9c40-4c4d-8d1f-3f3d35061b57 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:33.167480 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d63c3b54-9c40-4c4d-8d1f-3f3d35061b57 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:33.167957 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d63c3b54-9c40-4c4d-8d1f-3f3d35061b57 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:33.168672 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d63c3b54-9c40-4c4d-8d1f-3f3d35061b57 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:33.169126 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d63c3b54-9c40-4c4d-8d1f-3f3d35061b57 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:33.169549 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d63c3b54-9c40-4c4d-8d1f-3f3d35061b57 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:33.301436 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-d63c3b54-9c40-4c4d-8d1f-3f3d35061b57 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:33.310280 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-d63c3b54-9c40-4c4d-8d1f-3f3d35061b57 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:33.311725 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-d63c3b54-9c40-4c4d-8d1f-3f3d35061b57 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:33.312939 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-d63c3b54-9c40-4c4d-8d1f-3f3d35061b57 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 200 len: 1405 microversion: 2.20 time: 0.157516 Aug 26 00:58:33.313488 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 305/612] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:58:33 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:58:33.803154 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-407cb4fc-c0aa-4eed-900e-01234a6c5e56 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:33.803769 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-407cb4fc-c0aa-4eed-900e-01234a6c5e56 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:33.805739 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=1 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:33.810540 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-407cb4fc-c0aa-4eed-900e-01234a6c5e56 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:33.811022 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-407cb4fc-c0aa-4eed-900e-01234a6c5e56 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:33.811460 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-407cb4fc-c0aa-4eed-900e-01234a6c5e56 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:33.812145 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-407cb4fc-c0aa-4eed-900e-01234a6c5e56 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:33.812626 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-407cb4fc-c0aa-4eed-900e-01234a6c5e56 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:33.813052 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-407cb4fc-c0aa-4eed-900e-01234a6c5e56 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:33.939957 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-407cb4fc-c0aa-4eed-900e-01234a6c5e56 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:33.948217 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-407cb4fc-c0aa-4eed-900e-01234a6c5e56 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd" status: 200 len: 1737 microversion: 2.1 time: 0.148843 Aug 26 00:58:33.948756 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 308/613] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:58:33 2022] GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:58:34.335581 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-046c5ff2-d2d0-44b3-a8bf-1899cde9bd10 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:34.344494 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-046c5ff2-d2d0-44b3-a8bf-1899cde9bd10 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:34.344494 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-046c5ff2-d2d0-44b3-a8bf-1899cde9bd10 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:34.344494 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-046c5ff2-d2d0-44b3-a8bf-1899cde9bd10 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:34.344494 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-046c5ff2-d2d0-44b3-a8bf-1899cde9bd10 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:34.344888 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-046c5ff2-d2d0-44b3-a8bf-1899cde9bd10 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:34.345243 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-046c5ff2-d2d0-44b3-a8bf-1899cde9bd10 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:34.345656 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-046c5ff2-d2d0-44b3-a8bf-1899cde9bd10 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:34.475144 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-046c5ff2-d2d0-44b3-a8bf-1899cde9bd10 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:34.483142 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-046c5ff2-d2d0-44b3-a8bf-1899cde9bd10 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:34.484624 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-046c5ff2-d2d0-44b3-a8bf-1899cde9bd10 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:34.485719 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-046c5ff2-d2d0-44b3-a8bf-1899cde9bd10 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 200 len: 1405 microversion: 2.20 time: 0.154333 Aug 26 00:58:34.486263 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 306/614] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:58:34 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 1405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:58:34.969019 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-fece4723-3778-4865-9088-0ddd4bee8964 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:34.971133 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-fece4723-3778-4865-9088-0ddd4bee8964 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:34.975667 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fece4723-3778-4865-9088-0ddd4bee8964 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:34.976148 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fece4723-3778-4865-9088-0ddd4bee8964 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:34.976619 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fece4723-3778-4865-9088-0ddd4bee8964 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:34.977309 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fece4723-3778-4865-9088-0ddd4bee8964 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:34.977762 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fece4723-3778-4865-9088-0ddd4bee8964 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:34.978189 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fece4723-3778-4865-9088-0ddd4bee8964 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:34.997080 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:35.109397 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-fece4723-3778-4865-9088-0ddd4bee8964 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:35.117740 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-fece4723-3778-4865-9088-0ddd4bee8964 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd" status: 200 len: 1737 microversion: 2.1 time: 0.152761 Aug 26 00:58:35.118303 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 309/615] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:58:34 2022] GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:58:35.507852 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-e26a05bf-aa7b-411b-ac30-51dbe1270fd6 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:35.508451 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-e26a05bf-aa7b-411b-ac30-51dbe1270fd6 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:35.515478 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e26a05bf-aa7b-411b-ac30-51dbe1270fd6 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:35.515954 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e26a05bf-aa7b-411b-ac30-51dbe1270fd6 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:35.516385 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e26a05bf-aa7b-411b-ac30-51dbe1270fd6 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:35.517090 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e26a05bf-aa7b-411b-ac30-51dbe1270fd6 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:35.517537 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e26a05bf-aa7b-411b-ac30-51dbe1270fd6 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:35.517950 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e26a05bf-aa7b-411b-ac30-51dbe1270fd6 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:35.650299 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-e26a05bf-aa7b-411b-ac30-51dbe1270fd6 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:35.659041 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-e26a05bf-aa7b-411b-ac30-51dbe1270fd6 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:35.660529 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-e26a05bf-aa7b-411b-ac30-51dbe1270fd6 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:35.661663 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-e26a05bf-aa7b-411b-ac30-51dbe1270fd6 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 200 len: 1405 microversion: 2.20 time: 0.157711 Aug 26 00:58:35.662222 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 307/616] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:58:35 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:58:36.139348 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-fc0d78f5-06a0-486c-80e8-90433c8e2f09 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:36.139970 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-fc0d78f5-06a0-486c-80e8-90433c8e2f09 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:36.146197 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fc0d78f5-06a0-486c-80e8-90433c8e2f09 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:36.146686 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fc0d78f5-06a0-486c-80e8-90433c8e2f09 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:36.147128 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fc0d78f5-06a0-486c-80e8-90433c8e2f09 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:36.147830 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fc0d78f5-06a0-486c-80e8-90433c8e2f09 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:36.148281 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fc0d78f5-06a0-486c-80e8-90433c8e2f09 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:36.148743 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fc0d78f5-06a0-486c-80e8-90433c8e2f09 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:36.278780 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-fc0d78f5-06a0-486c-80e8-90433c8e2f09 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:36.287705 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-fc0d78f5-06a0-486c-80e8-90433c8e2f09 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd" status: 200 len: 1737 microversion: 2.1 time: 0.152527 Aug 26 00:58:36.288276 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 310/617] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:58:36 2022] GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:58:36.685262 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-c07d8d62-9967-43d7-8e0f-8b58d205638f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:36.686530 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-c07d8d62-9967-43d7-8e0f-8b58d205638f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:36.688945 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:36.693614 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c07d8d62-9967-43d7-8e0f-8b58d205638f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:36.694087 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c07d8d62-9967-43d7-8e0f-8b58d205638f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:36.694514 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c07d8d62-9967-43d7-8e0f-8b58d205638f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:36.695193 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c07d8d62-9967-43d7-8e0f-8b58d205638f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:36.695630 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c07d8d62-9967-43d7-8e0f-8b58d205638f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:36.696041 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c07d8d62-9967-43d7-8e0f-8b58d205638f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:36.825258 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-c07d8d62-9967-43d7-8e0f-8b58d205638f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:36.833257 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-c07d8d62-9967-43d7-8e0f-8b58d205638f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:36.834683 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-c07d8d62-9967-43d7-8e0f-8b58d205638f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:36.835812 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-c07d8d62-9967-43d7-8e0f-8b58d205638f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 200 len: 1405 microversion: 2.20 time: 0.154456 Aug 26 00:58:36.836375 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 308/618] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:58:36 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:58:37.309974 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-c119f334-b909-4cd5-b9dd-e6694cc32951 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:37.311234 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-c119f334-b909-4cd5-b9dd-e6694cc32951 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:37.317270 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c119f334-b909-4cd5-b9dd-e6694cc32951 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:37.317754 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c119f334-b909-4cd5-b9dd-e6694cc32951 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:37.318190 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c119f334-b909-4cd5-b9dd-e6694cc32951 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:37.318878 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c119f334-b909-4cd5-b9dd-e6694cc32951 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:37.319330 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c119f334-b909-4cd5-b9dd-e6694cc32951 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:37.319755 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c119f334-b909-4cd5-b9dd-e6694cc32951 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:37.450825 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-c119f334-b909-4cd5-b9dd-e6694cc32951 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:37.459380 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-c119f334-b909-4cd5-b9dd-e6694cc32951 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd" status: 200 len: 1737 microversion: 2.1 time: 0.153212 Aug 26 00:58:37.459944 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 311/619] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:58:37 2022] GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:58:37.863146 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-d768aa27-af88-4cc2-836d-65c5824c575a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:37.864255 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-d768aa27-af88-4cc2-836d-65c5824c575a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:37.867341 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell0:SELECT=2 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:37.868430 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell0:SELECT=10 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:37.877642 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d768aa27-af88-4cc2-836d-65c5824c575a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:37.878548 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d768aa27-af88-4cc2-836d-65c5824c575a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:37.879335 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d768aa27-af88-4cc2-836d-65c5824c575a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:37.880673 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d768aa27-af88-4cc2-836d-65c5824c575a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:37.881495 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d768aa27-af88-4cc2-836d-65c5824c575a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:37.882245 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d768aa27-af88-4cc2-836d-65c5824c575a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:38.036386 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-d768aa27-af88-4cc2-836d-65c5824c575a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:38.045063 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-d768aa27-af88-4cc2-836d-65c5824c575a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:38.046496 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-d768aa27-af88-4cc2-836d-65c5824c575a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:38.047609 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-d768aa27-af88-4cc2-836d-65c5824c575a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 200 len: 1405 microversion: 2.20 time: 0.192091 Aug 26 00:58:38.048358 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 309/620] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:58:37 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 1405 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:58:38.121360 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [req-e00b88d2-5ec6-4335-b966-d699b33e6684 req-a1521003-f907-49e8-9212-83156de074a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8af18a63-5c10-4530-9072-6ca92223b8ec", "name": "network-vif-plugged", "status": "completed", "tag": "abc8d4e4-fe47-4480-9cbb-c4ca4d73b355"}]} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:58:38.126338 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell0:SELECT=2 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:38.131575 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-e00b88d2-5ec6-4335-b966-d699b33e6684 req-a1521003-f907-49e8-9212-83156de074a2 service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:38.132048 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-e00b88d2-5ec6-4335-b966-d699b33e6684 req-a1521003-f907-49e8-9212-83156de074a2 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:38.132504 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-e00b88d2-5ec6-4335-b966-d699b33e6684 req-a1521003-f907-49e8-9212-83156de074a2 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:38.144127 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.compute.server_external_events [req-e00b88d2-5ec6-4335-b966-d699b33e6684 req-a1521003-f907-49e8-9212-83156de074a2 service nova] Creating event network-vif-plugged:abc8d4e4-fe47-4480-9cbb-c4ca4d73b355 for instance 8af18a63-5c10-4530-9072-6ca92223b8ec on hv-cinder-83538 Aug 26 00:58:38.149208 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [req-e00b88d2-5ec6-4335-b966-d699b33e6684 req-a1521003-f907-49e8-9212-83156de074a2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031479 Aug 26 00:58:38.149785 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 312/621] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 00:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:58:38.480365 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-6f718d69-3784-4928-9966-dcbde6a4dff0 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:38.480935 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-6f718d69-3784-4928-9966-dcbde6a4dff0 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:38.486916 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6f718d69-3784-4928-9966-dcbde6a4dff0 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:38.487401 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6f718d69-3784-4928-9966-dcbde6a4dff0 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:38.487839 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6f718d69-3784-4928-9966-dcbde6a4dff0 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:38.488549 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6f718d69-3784-4928-9966-dcbde6a4dff0 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:38.489004 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6f718d69-3784-4928-9966-dcbde6a4dff0 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:38.489428 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6f718d69-3784-4928-9966-dcbde6a4dff0 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:38.507843 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell1:SELECT=100 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:38.618791 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-6f718d69-3784-4928-9966-dcbde6a4dff0 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:38.626967 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-6f718d69-3784-4928-9966-dcbde6a4dff0 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd" status: 200 len: 1737 microversion: 2.1 time: 0.150628 Aug 26 00:58:38.627528 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 310/622] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:58:38 2022] GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:58:39.070266 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-aca7ae8e-9042-4cac-b1f8-3d6a7b1549dd tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:39.070964 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-aca7ae8e-9042-4cac-b1f8-3d6a7b1549dd tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:39.077492 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-aca7ae8e-9042-4cac-b1f8-3d6a7b1549dd tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:39.077979 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-aca7ae8e-9042-4cac-b1f8-3d6a7b1549dd tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:39.078419 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-aca7ae8e-9042-4cac-b1f8-3d6a7b1549dd tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:39.079116 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-aca7ae8e-9042-4cac-b1f8-3d6a7b1549dd tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:39.079569 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-aca7ae8e-9042-4cac-b1f8-3d6a7b1549dd tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:39.079995 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-aca7ae8e-9042-4cac-b1f8-3d6a7b1549dd tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:39.209822 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-aca7ae8e-9042-4cac-b1f8-3d6a7b1549dd tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:39.218362 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-aca7ae8e-9042-4cac-b1f8-3d6a7b1549dd tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:39.219771 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-aca7ae8e-9042-4cac-b1f8-3d6a7b1549dd tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:39.220887 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-aca7ae8e-9042-4cac-b1f8-3d6a7b1549dd tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 200 len: 1405 microversion: 2.20 time: 0.154926 Aug 26 00:58:39.221442 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 313/623] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:58:39 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:58:39.648595 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-080251d6-becb-4120-827b-49c290be3d66 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:39.649263 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-080251d6-becb-4120-827b-49c290be3d66 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:39.656382 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-080251d6-becb-4120-827b-49c290be3d66 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:39.656972 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-080251d6-becb-4120-827b-49c290be3d66 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:39.657470 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-080251d6-becb-4120-827b-49c290be3d66 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:39.658250 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-080251d6-becb-4120-827b-49c290be3d66 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:39.658876 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-080251d6-becb-4120-827b-49c290be3d66 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:39.659293 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-080251d6-becb-4120-827b-49c290be3d66 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:39.949023 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-080251d6-becb-4120-827b-49c290be3d66 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:39.957765 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-080251d6-becb-4120-827b-49c290be3d66 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd" status: 200 len: 1737 microversion: 2.1 time: 0.313072 Aug 26 00:58:39.958331 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 311/624] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:58:39 2022] GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd => generated 1737 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:58:40.243375 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-76a95a27-d997-4f00-a628-225324ba8d66 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:40.243909 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-76a95a27-d997-4f00-a628-225324ba8d66 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:40.250383 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-76a95a27-d997-4f00-a628-225324ba8d66 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:40.250851 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-76a95a27-d997-4f00-a628-225324ba8d66 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:40.251277 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-76a95a27-d997-4f00-a628-225324ba8d66 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:40.251949 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-76a95a27-d997-4f00-a628-225324ba8d66 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:40.252392 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-76a95a27-d997-4f00-a628-225324ba8d66 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:40.252851 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-76a95a27-d997-4f00-a628-225324ba8d66 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:40.439062 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-76a95a27-d997-4f00-a628-225324ba8d66 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:40.447156 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-76a95a27-d997-4f00-a628-225324ba8d66 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:40.448604 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-76a95a27-d997-4f00-a628-225324ba8d66 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:40.449703 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-76a95a27-d997-4f00-a628-225324ba8d66 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 200 len: 1405 microversion: 2.20 time: 0.210234 Aug 26 00:58:40.450247 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 314/625] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:58:40 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 1405 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:58:40.978272 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-3c7b0892-a5ed-4561-9972-ab3b97fa8700 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:40.978966 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-3c7b0892-a5ed-4561-9972-ab3b97fa8700 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:40.985479 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3c7b0892-a5ed-4561-9972-ab3b97fa8700 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:40.985960 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3c7b0892-a5ed-4561-9972-ab3b97fa8700 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:40.986394 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3c7b0892-a5ed-4561-9972-ab3b97fa8700 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:40.987073 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3c7b0892-a5ed-4561-9972-ab3b97fa8700 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:40.987528 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3c7b0892-a5ed-4561-9972-ab3b97fa8700 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:40.987948 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3c7b0892-a5ed-4561-9972-ab3b97fa8700 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:41.115620 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-3c7b0892-a5ed-4561-9972-ab3b97fa8700 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:41.124743 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-3c7b0892-a5ed-4561-9972-ab3b97fa8700 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd" status: 200 len: 1737 microversion: 2.1 time: 0.150329 Aug 26 00:58:41.125315 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 312/626] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:58:40 2022] GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:58:41.471271 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-a8318b34-174e-4771-97c0-bb80c12f8ea3 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:41.486276 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-a8318b34-174e-4771-97c0-bb80c12f8ea3 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:41.486276 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a8318b34-174e-4771-97c0-bb80c12f8ea3 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:41.486276 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a8318b34-174e-4771-97c0-bb80c12f8ea3 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:41.486276 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a8318b34-174e-4771-97c0-bb80c12f8ea3 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:41.486675 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a8318b34-174e-4771-97c0-bb80c12f8ea3 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:41.486675 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a8318b34-174e-4771-97c0-bb80c12f8ea3 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:41.486675 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a8318b34-174e-4771-97c0-bb80c12f8ea3 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:41.608239 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-a8318b34-174e-4771-97c0-bb80c12f8ea3 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:41.616259 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-a8318b34-174e-4771-97c0-bb80c12f8ea3 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:41.617721 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-a8318b34-174e-4771-97c0-bb80c12f8ea3 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:41.618861 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-a8318b34-174e-4771-97c0-bb80c12f8ea3 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 200 len: 1598 microversion: 2.20 time: 0.151476 Aug 26 00:58:41.619416 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 315/627] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:58:41 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 1598 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:58:41.640892 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-deb50946-ea72-4a48-919c-34e0ba6cfbe3 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:41.641385 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-deb50946-ea72-4a48-919c-34e0ba6cfbe3 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:41.647347 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-deb50946-ea72-4a48-919c-34e0ba6cfbe3 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:41.647833 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-deb50946-ea72-4a48-919c-34e0ba6cfbe3 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:41.648271 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-deb50946-ea72-4a48-919c-34e0ba6cfbe3 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:41.648984 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-deb50946-ea72-4a48-919c-34e0ba6cfbe3 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:41.649441 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-deb50946-ea72-4a48-919c-34e0ba6cfbe3 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:41.649865 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-deb50946-ea72-4a48-919c-34e0ba6cfbe3 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:41.727122 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-deb50946-ea72-4a48-919c-34e0ba6cfbe3 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.090132 Aug 26 00:58:41.727719 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 313/628] 10.222.0.59 () {60 vars in 1316 bytes} [Fri Aug 26 00:58:41 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 00:58:42.145476 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-99132ade-db5c-4240-89bc-5d1afd5cffeb tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:42.146087 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-99132ade-db5c-4240-89bc-5d1afd5cffeb tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:42.151894 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-99132ade-db5c-4240-89bc-5d1afd5cffeb tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:42.152633 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-99132ade-db5c-4240-89bc-5d1afd5cffeb tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:42.152907 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-99132ade-db5c-4240-89bc-5d1afd5cffeb tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:42.153519 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-99132ade-db5c-4240-89bc-5d1afd5cffeb tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:42.154008 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-99132ade-db5c-4240-89bc-5d1afd5cffeb tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:42.154438 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-99132ade-db5c-4240-89bc-5d1afd5cffeb tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:42.287536 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-99132ade-db5c-4240-89bc-5d1afd5cffeb tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:42.296260 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-99132ade-db5c-4240-89bc-5d1afd5cffeb tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd" status: 200 len: 1717 microversion: 2.1 time: 0.154583 Aug 26 00:58:42.296862 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 316/629] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:58:42 2022] GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd => generated 1717 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:58:42.407226 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-531a4341-673a-4956-8c4d-04544272e8d5 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:42.407777 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-531a4341-673a-4956-8c4d-04544272e8d5 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:42.414161 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-531a4341-673a-4956-8c4d-04544272e8d5 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:42.414651 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-531a4341-673a-4956-8c4d-04544272e8d5 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:42.415089 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-531a4341-673a-4956-8c4d-04544272e8d5 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:42.415837 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-531a4341-673a-4956-8c4d-04544272e8d5 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:42.416290 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-531a4341-673a-4956-8c4d-04544272e8d5 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:42.416776 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-531a4341-673a-4956-8c4d-04544272e8d5 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:42.549610 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.wsgi [None req-531a4341-673a-4956-8c4d-04544272e8d5 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] HTTP exception thrown: Cannot 'detach_volume' instance 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd while it is in vm_state rescued Aug 26 00:58:42.551421 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-531a4341-673a-4956-8c4d-04544272e8d5 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Request method failure captured: Aug 26 00:58:42.551421 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: request: DELETE /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd/os-volume_attachments/40d6b3f6-fcb9-43af-acbd-fff8f85abb20 HTTP/1.1 Aug 26 00:58:42.551421 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Accept: application/json Aug 26 00:58:42.551421 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Accept-Encoding: identity Aug 26 00:58:42.551421 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Connection: close Aug 26 00:58:42.551421 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Content-Length: 0 Aug 26 00:58:42.551421 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Content-Type: application/json Aug 26 00:58:42.551421 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Host: 10.222.0.59 Aug 26 00:58:42.551421 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Openstack-System-Scope: None Aug 26 00:58:42.551421 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: User-Agent: python-urllib3/1.26.11 Aug 26 00:58:42.551421 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Auth-Token: gAAAAABjCBmefHFNNUqFlMUE7I3i-93USVXZAM-jGRx67LwRrBQPHws8Ly74cPkf0mck5rrbALQjBE8Uy7qr03rwitlw4-vjXBtSJZuAAkljOdu1vNSZ4iHfo9uVWiTpSJogUteHYoVEbCAE9IBTiJYBlMj1AATIr86-7txLA_xIrQ0LluUT1u0 Aug 26 00:58:42.551421 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Domain-Id: None Aug 26 00:58:42.551421 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Domain-Name: None Aug 26 00:58:42.551421 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Identity-Status: Confirmed Aug 26 00:58:42.551421 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Is-Admin-Project: True Aug 26 00:58:42.551421 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Domain-Id: default Aug 26 00:58:42.551421 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Domain-Name: Default Aug 26 00:58:42.551421 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Id: 368f6a9e030e4aff9ef6559a6a165975 Aug 26 00:58:42.551421 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-988292211 Aug 26 00:58:42.551421 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Role: reader,member Aug 26 00:58:42.551421 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Roles: reader,member Aug 26 00:58:42.559743 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_368f6a9e030e4aff9ef6559a6a165975"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/368f6a9e030e4aff9ef6559a6a165975"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/368f6a9e030e4aff9ef6559a6a165975"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/368f6a9e030e4aff9ef6559a6a165975"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 00:58:42.559743 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant: tempest-ServerRescueNegativeTestJSON-988292211 Aug 26 00:58:42.559743 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant-Id: 368f6a9e030e4aff9ef6559a6a165975 Aug 26 00:58:42.559743 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-988292211 Aug 26 00:58:42.559743 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User: tempest-ServerRescueNegativeTestJSON-988292211-project Aug 26 00:58:42.559743 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Domain-Id: default Aug 26 00:58:42.559743 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Domain-Name: Default Aug 26 00:58:42.559743 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Id: 0cc36def73aa4bedb9e79d4cf11f5e8c Aug 26 00:58:42.559743 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Name: tempest-ServerRescueNegativeTestJSON-988292211-project Aug 26 00:58:42.559743 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: method: > Aug 26 00:58:42.559743 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: exception: Cannot 'detach_volume' instance 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd while it is in vm_state rescued Aug 26 00:58:42.560649 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: action_args: {'server_id': '81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd', 'id': '40d6b3f6-fcb9-43af-acbd-fff8f85abb20'} Aug 26 00:58:42.560649 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 00:58:42.560649 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:58:42.560649 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 26 00:58:42.560649 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 26 00:58:42.560649 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 26 00:58:42.560649 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 26 00:58:42.560649 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 26 00:58:42.560649 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 26 00:58:42.560649 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 26 00:58:42.560649 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:58:42.560649 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 00:58:42.560649 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:58:42.560649 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:58:42.560649 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 00:58:42.560649 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 00:58:42.560649 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 00:58:42.560649 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 00:58:42.560649 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 00:58:42.560649 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 00:58:42.561915 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 26 00:58:42.561915 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 26 00:58:42.561915 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 26 00:58:42.561915 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 26 00:58:42.561915 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd while it is in vm_state rescued Aug 26 00:58:42.561915 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:58:42.561915 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 00:58:42.561915 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:58:42.561915 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:58:42.561915 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 00:58:42.561915 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 00:58:42.561915 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 00:58:42.561915 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 00:58:42.561915 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd while it is in vm_state rescued Aug 26 00:58:42.561915 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:58:42.561915 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-531a4341-673a-4956-8c4d-04544272e8d5 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Returning 409 to user: Cannot 'detach_volume' instance 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd while it is in vm_state rescued {{(pid=127565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 00:58:42.563688 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-531a4341-673a-4956-8c4d-04544272e8d5 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "DELETE /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd/os-volume_attachments/40d6b3f6-fcb9-43af-acbd-fff8f85abb20" status: 409 len: 152 microversion: 2.1 time: 0.150386 Aug 26 00:58:42.563688 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 314/630] 10.222.0.59 () {58 vars in 1416 bytes} [Fri Aug 26 00:58:42 2022] DELETE /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd/os-volume_attachments/40d6b3f6-fcb9-43af-acbd-fff8f85abb20 => generated 152 bytes in 151 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 26 00:58:42.564008 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-461b3579-a54e-446e-8587-98295bf72b52 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:58:42.564008 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-461b3579-a54e-446e-8587-98295bf72b52 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:42.571795 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-461b3579-a54e-446e-8587-98295bf72b52 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:42.572316 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-461b3579-a54e-446e-8587-98295bf72b52 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:42.572786 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-461b3579-a54e-446e-8587-98295bf72b52 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:42.573496 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-461b3579-a54e-446e-8587-98295bf72b52 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:42.573950 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-461b3579-a54e-446e-8587-98295bf72b52 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:42.574395 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-461b3579-a54e-446e-8587-98295bf72b52 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:42.712223 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [req-9f029fcd-b09b-4478-91b6-1931b80e7ec5 req-8d380603-7b20-454d-b2be-30b8ac536ec1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8af18a63-5c10-4530-9072-6ca92223b8ec", "tag": "abc8d4e4-fe47-4480-9cbb-c4ca4d73b355"}]} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:58:42.723236 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-9f029fcd-b09b-4478-91b6-1931b80e7ec5 req-8d380603-7b20-454d-b2be-30b8ac536ec1 service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:42.723764 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-9f029fcd-b09b-4478-91b6-1931b80e7ec5 req-8d380603-7b20-454d-b2be-30b8ac536ec1 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:42.724275 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-9f029fcd-b09b-4478-91b6-1931b80e7ec5 req-8d380603-7b20-454d-b2be-30b8ac536ec1 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:42.736096 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.compute.server_external_events [req-9f029fcd-b09b-4478-91b6-1931b80e7ec5 req-8d380603-7b20-454d-b2be-30b8ac536ec1 service nova] Creating event network-changed:abc8d4e4-fe47-4480-9cbb-c4ca4d73b355 for instance 8af18a63-5c10-4530-9072-6ca92223b8ec on hv-cinder-83538 Aug 26 00:58:42.741762 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [req-9f029fcd-b09b-4478-91b6-1931b80e7ec5 req-8d380603-7b20-454d-b2be-30b8ac536ec1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033561 Aug 26 00:58:42.743151 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 315/631] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 00:58:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 00:58:42.794330 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-461b3579-a54e-446e-8587-98295bf72b52 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "POST /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd/action" status: 202 len: 0 microversion: 2.1 time: 0.236373 Aug 26 00:58:42.795215 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 317/632] 10.222.0.59 () {60 vars in 1278 bytes} [Fri Aug 26 00:58:42 2022] POST /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 26 00:58:42.803831 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-e990f873-046e-4de9-9ef7-31320b973eff tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:42.804534 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-e990f873-046e-4de9-9ef7-31320b973eff tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:42.811633 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e990f873-046e-4de9-9ef7-31320b973eff tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:42.812416 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e990f873-046e-4de9-9ef7-31320b973eff tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:42.813091 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e990f873-046e-4de9-9ef7-31320b973eff tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:42.814067 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e990f873-046e-4de9-9ef7-31320b973eff tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:42.814707 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e990f873-046e-4de9-9ef7-31320b973eff tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:42.815321 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e990f873-046e-4de9-9ef7-31320b973eff tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:42.964992 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-e990f873-046e-4de9-9ef7-31320b973eff tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:42.983369 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-e990f873-046e-4de9-9ef7-31320b973eff tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd" status: 200 len: 1725 microversion: 2.1 time: 0.183644 Aug 26 00:58:42.987949 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 316/633] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:58:42 2022] GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd => generated 1725 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:58:44.006907 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-2c004856-6e4d-4587-83ed-3f886cca8b69 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:44.007519 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-2c004856-6e4d-4587-83ed-3f886cca8b69 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:44.013745 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2c004856-6e4d-4587-83ed-3f886cca8b69 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:44.018937 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2c004856-6e4d-4587-83ed-3f886cca8b69 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:44.018937 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2c004856-6e4d-4587-83ed-3f886cca8b69 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:44.018937 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2c004856-6e4d-4587-83ed-3f886cca8b69 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:44.018937 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2c004856-6e4d-4587-83ed-3f886cca8b69 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:44.019336 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2c004856-6e4d-4587-83ed-3f886cca8b69 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:44.158399 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-2c004856-6e4d-4587-83ed-3f886cca8b69 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:44.166920 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-2c004856-6e4d-4587-83ed-3f886cca8b69 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd" status: 200 len: 1725 microversion: 2.1 time: 0.164414 Aug 26 00:58:44.167477 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 318/634] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:58:44 2022] GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:58:45.188867 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-433595bc-d62c-490d-bbe5-71b87c8567c0 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:45.189525 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-433595bc-d62c-490d-bbe5-71b87c8567c0 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:45.195988 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-433595bc-d62c-490d-bbe5-71b87c8567c0 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:45.196480 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-433595bc-d62c-490d-bbe5-71b87c8567c0 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:45.196937 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-433595bc-d62c-490d-bbe5-71b87c8567c0 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:45.197622 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-433595bc-d62c-490d-bbe5-71b87c8567c0 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:45.198072 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-433595bc-d62c-490d-bbe5-71b87c8567c0 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:45.198503 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-433595bc-d62c-490d-bbe5-71b87c8567c0 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:45.331747 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-433595bc-d62c-490d-bbe5-71b87c8567c0 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:45.340009 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-433595bc-d62c-490d-bbe5-71b87c8567c0 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd" status: 200 len: 1725 microversion: 2.1 time: 0.155552 Aug 26 00:58:45.340607 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 317/635] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:58:45 2022] GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:58:46.361682 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-296e185d-d6bb-4b55-bd1f-16e626abb101 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:46.362264 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-296e185d-d6bb-4b55-bd1f-16e626abb101 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:46.368063 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-296e185d-d6bb-4b55-bd1f-16e626abb101 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:46.369376 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-296e185d-d6bb-4b55-bd1f-16e626abb101 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:46.369376 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-296e185d-d6bb-4b55-bd1f-16e626abb101 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:46.369675 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-296e185d-d6bb-4b55-bd1f-16e626abb101 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:46.370125 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-296e185d-d6bb-4b55-bd1f-16e626abb101 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:46.370548 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-296e185d-d6bb-4b55-bd1f-16e626abb101 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:46.497835 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-296e185d-d6bb-4b55-bd1f-16e626abb101 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:58:46.506600 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-296e185d-d6bb-4b55-bd1f-16e626abb101 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd" status: 200 len: 1731 microversion: 2.1 time: 0.148846 Aug 26 00:58:46.511659 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 319/636] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:58:46 2022] GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd => generated 1731 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:58:46.527532 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-e35b0f7b-981d-4b5a-a095-c95a644925aa tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:46.528028 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-e35b0f7b-981d-4b5a-a095-c95a644925aa tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:46.534397 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e35b0f7b-981d-4b5a-a095-c95a644925aa tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:46.540422 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e35b0f7b-981d-4b5a-a095-c95a644925aa tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:46.540422 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e35b0f7b-981d-4b5a-a095-c95a644925aa tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:46.540422 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e35b0f7b-981d-4b5a-a095-c95a644925aa tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:46.540422 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e35b0f7b-981d-4b5a-a095-c95a644925aa tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:46.540879 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e35b0f7b-981d-4b5a-a095-c95a644925aa tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:46.613062 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-e35b0f7b-981d-4b5a-a095-c95a644925aa tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089264 Aug 26 00:58:46.613604 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 318/637] 10.222.0.59 () {58 vars in 1275 bytes} [Fri Aug 26 00:58:46 2022] GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:58:47.543615 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [req-bd4b800e-3e7a-4538-9019-0fa96079b175 req-3012154c-d9c6-487d-925e-74eae7347ca0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd", "tag": "56f607c1-adc1-4120-ac0a-38b41904464e"}]} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:58:47.554161 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-bd4b800e-3e7a-4538-9019-0fa96079b175 req-3012154c-d9c6-487d-925e-74eae7347ca0 service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:47.554992 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-bd4b800e-3e7a-4538-9019-0fa96079b175 req-3012154c-d9c6-487d-925e-74eae7347ca0 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:47.555425 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-bd4b800e-3e7a-4538-9019-0fa96079b175 req-3012154c-d9c6-487d-925e-74eae7347ca0 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:47.570283 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.compute.server_external_events [req-bd4b800e-3e7a-4538-9019-0fa96079b175 req-3012154c-d9c6-487d-925e-74eae7347ca0 service nova] Creating event network-changed:56f607c1-adc1-4120-ac0a-38b41904464e for instance 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd on hv-cinder-83538 Aug 26 00:58:47.572843 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [req-bd4b800e-3e7a-4538-9019-0fa96079b175 req-3012154c-d9c6-487d-925e-74eae7347ca0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032878 Aug 26 00:58:47.573863 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 320/638] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 00:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 00:58:49.589429 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [req-248438dd-a5d7-4a7d-87b8-74c0807fd54f req-5dfd63e6-45f0-4d1f-a777-c5d5250d763d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd", "tag": "56f607c1-adc1-4120-ac0a-38b41904464e"}]} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:58:49.599891 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-248438dd-a5d7-4a7d-87b8-74c0807fd54f req-5dfd63e6-45f0-4d1f-a777-c5d5250d763d service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:49.600417 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-248438dd-a5d7-4a7d-87b8-74c0807fd54f req-5dfd63e6-45f0-4d1f-a777-c5d5250d763d service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:49.601021 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-248438dd-a5d7-4a7d-87b8-74c0807fd54f req-5dfd63e6-45f0-4d1f-a777-c5d5250d763d service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:49.613485 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.compute.server_external_events [req-248438dd-a5d7-4a7d-87b8-74c0807fd54f req-5dfd63e6-45f0-4d1f-a777-c5d5250d763d service nova] Creating event network-changed:56f607c1-adc1-4120-ac0a-38b41904464e for instance 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd on hv-cinder-83538 Aug 26 00:58:49.618461 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [req-248438dd-a5d7-4a7d-87b8-74c0807fd54f req-5dfd63e6-45f0-4d1f-a777-c5d5250d763d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033582 Aug 26 00:58:49.619061 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 319/639] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 00:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:58:59.543728 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-6b759304-ceec-43d1-a62f-f06c9d9d0bb8 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:59.546081 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-6b759304-ceec-43d1-a62f-f06c9d9d0bb8 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:59.548873 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_api:SELECT=25 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:59.549517 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:59.554834 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6b759304-ceec-43d1-a62f-f06c9d9d0bb8 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:59.555314 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6b759304-ceec-43d1-a62f-f06c9d9d0bb8 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:59.555747 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6b759304-ceec-43d1-a62f-f06c9d9d0bb8 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:59.556439 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6b759304-ceec-43d1-a62f-f06c9d9d0bb8 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:59.556932 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6b759304-ceec-43d1-a62f-f06c9d9d0bb8 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:59.567427 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6b759304-ceec-43d1-a62f-f06c9d9d0bb8 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:59.586921 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-6b759304-ceec-43d1-a62f-f06c9d9d0bb8 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047430 Aug 26 00:58:59.602420 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 321/640] 10.222.0.59 () {58 vars in 1302 bytes} [Fri Aug 26 00:58:59 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 00:58:59.650907 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-4d37af5e-fcc1-4c39-adf0-396070939266 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:59.651489 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-4d37af5e-fcc1-4c39-adf0-396070939266 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:59.654437 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_api:SELECT=23 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:59.655211 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell1:SELECT=44 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:59.659935 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4d37af5e-fcc1-4c39-adf0-396070939266 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:59.660465 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4d37af5e-fcc1-4c39-adf0-396070939266 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:59.660932 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4d37af5e-fcc1-4c39-adf0-396070939266 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:59.664808 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4d37af5e-fcc1-4c39-adf0-396070939266 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:59.664808 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4d37af5e-fcc1-4c39-adf0-396070939266 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:59.664808 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4d37af5e-fcc1-4c39-adf0-396070939266 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:59.688633 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-4d37af5e-fcc1-4c39-adf0-396070939266 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Going to try to terminate instance {{(pid=127565) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 00:58:59.977217 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-4d37af5e-fcc1-4c39-adf0-396070939266 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "DELETE /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 204 len: 0 microversion: 2.1 time: 0.330116 Aug 26 00:58:59.977797 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 320/641] 10.222.0.59 () {58 vars in 1239 bytes} [Fri Aug 26 00:58:59 2022] DELETE /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 00:58:59.986273 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-4d73cd57-1e8d-4a4c-9984-5b8455c27591 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:58:59.988405 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-4d73cd57-1e8d-4a4c-9984-5b8455c27591 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:58:59.993591 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-4d73cd57-1e8d-4a4c-9984-5b8455c27591 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:59.994107 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-4d73cd57-1e8d-4a4c-9984-5b8455c27591 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:59.994544 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-4d73cd57-1e8d-4a4c-9984-5b8455c27591 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:58:59.995227 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-4d73cd57-1e8d-4a4c-9984-5b8455c27591 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:58:59.995681 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-4d73cd57-1e8d-4a4c-9984-5b8455c27591 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:58:59.996107 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-4d73cd57-1e8d-4a4c-9984-5b8455c27591 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:00.128653 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-4d73cd57-1e8d-4a4c-9984-5b8455c27591 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:00.136594 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-4d73cd57-1e8d-4a4c-9984-5b8455c27591 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1671 microversion: 2.1 time: 0.154510 Aug 26 00:59:00.137181 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 322/642] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:58:59 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1671 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:59:01.159745 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-e4bb24d1-0f61-4404-9b2c-139d4f0061d3 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:01.160440 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-e4bb24d1-0f61-4404-9b2c-139d4f0061d3 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:01.167090 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e4bb24d1-0f61-4404-9b2c-139d4f0061d3 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:01.167569 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e4bb24d1-0f61-4404-9b2c-139d4f0061d3 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:01.168004 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e4bb24d1-0f61-4404-9b2c-139d4f0061d3 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:01.168711 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e4bb24d1-0f61-4404-9b2c-139d4f0061d3 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:01.169167 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e4bb24d1-0f61-4404-9b2c-139d4f0061d3 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:01.169592 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e4bb24d1-0f61-4404-9b2c-139d4f0061d3 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:01.298009 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-e4bb24d1-0f61-4404-9b2c-139d4f0061d3 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:01.305666 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-e4bb24d1-0f61-4404-9b2c-139d4f0061d3 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1671 microversion: 2.1 time: 0.150706 Aug 26 00:59:01.306264 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 321/643] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:59:01 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1671 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:59:02.326220 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-c0633c1f-5d4f-4c29-85a8-9567d22440a9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:02.326850 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-c0633c1f-5d4f-4c29-85a8-9567d22440a9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:02.333425 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c0633c1f-5d4f-4c29-85a8-9567d22440a9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:02.333906 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c0633c1f-5d4f-4c29-85a8-9567d22440a9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:02.334336 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c0633c1f-5d4f-4c29-85a8-9567d22440a9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:02.335018 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c0633c1f-5d4f-4c29-85a8-9567d22440a9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:02.335469 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c0633c1f-5d4f-4c29-85a8-9567d22440a9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:02.335891 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c0633c1f-5d4f-4c29-85a8-9567d22440a9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:02.464206 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-c0633c1f-5d4f-4c29-85a8-9567d22440a9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:02.472308 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-c0633c1f-5d4f-4c29-85a8-9567d22440a9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1671 microversion: 2.1 time: 0.149902 Aug 26 00:59:02.472926 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 323/644] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:59:02 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1671 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:59:03.493510 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-44c77789-9002-4938-9650-b49645e89c89 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:03.494151 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-44c77789-9002-4938-9650-b49645e89c89 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:03.500814 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-44c77789-9002-4938-9650-b49645e89c89 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:03.501296 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-44c77789-9002-4938-9650-b49645e89c89 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:03.501736 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-44c77789-9002-4938-9650-b49645e89c89 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:03.502426 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-44c77789-9002-4938-9650-b49645e89c89 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:03.502872 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-44c77789-9002-4938-9650-b49645e89c89 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:03.503296 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-44c77789-9002-4938-9650-b49645e89c89 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:03.586822 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-44c77789-9002-4938-9650-b49645e89c89 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:03.594709 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-44c77789-9002-4938-9650-b49645e89c89 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1604 microversion: 2.1 time: 0.105157 Aug 26 00:59:03.595483 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 322/645] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:59:03 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1604 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:59:03.689001 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [req-ab3fe78f-91b8-41ee-981f-09d7508e0d85 req-a48bfb7a-a2c0-4ec2-bede-d985f2d7340d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "730816fc-0c43-43e3-ab6e-e7f324e403d7", "name": "network-vif-deleted", "tag": "9a9a5c66-fe0c-40d8-ae1a-65494e24310f"}]} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:59:03.699458 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-ab3fe78f-91b8-41ee-981f-09d7508e0d85 req-a48bfb7a-a2c0-4ec2-bede-d985f2d7340d service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:03.699934 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-ab3fe78f-91b8-41ee-981f-09d7508e0d85 req-a48bfb7a-a2c0-4ec2-bede-d985f2d7340d service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:03.700388 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-ab3fe78f-91b8-41ee-981f-09d7508e0d85 req-a48bfb7a-a2c0-4ec2-bede-d985f2d7340d service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:03.714481 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.compute.server_external_events [req-ab3fe78f-91b8-41ee-981f-09d7508e0d85 req-a48bfb7a-a2c0-4ec2-bede-d985f2d7340d service nova] Creating event network-vif-deleted:9a9a5c66-fe0c-40d8-ae1a-65494e24310f for instance 730816fc-0c43-43e3-ab6e-e7f324e403d7 on hv-cinder-83538 Aug 26 00:59:03.719922 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [req-ab3fe78f-91b8-41ee-981f-09d7508e0d85 req-a48bfb7a-a2c0-4ec2-bede-d985f2d7340d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038245 Aug 26 00:59:03.721373 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 324/646] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 00:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:59:04.616746 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-01adda1c-f2f4-410b-97e5-07b61bc93094 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:04.617352 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-01adda1c-f2f4-410b-97e5-07b61bc93094 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:04.623751 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-01adda1c-f2f4-410b-97e5-07b61bc93094 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:04.624235 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-01adda1c-f2f4-410b-97e5-07b61bc93094 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:04.624696 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-01adda1c-f2f4-410b-97e5-07b61bc93094 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:04.625383 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-01adda1c-f2f4-410b-97e5-07b61bc93094 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:04.625871 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-01adda1c-f2f4-410b-97e5-07b61bc93094 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:04.626296 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-01adda1c-f2f4-410b-97e5-07b61bc93094 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:04.659673 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-01adda1c-f2f4-410b-97e5-07b61bc93094 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:04.659673 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-01adda1c-f2f4-410b-97e5-07b61bc93094 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:04.659840 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-01adda1c-f2f4-410b-97e5-07b61bc93094 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:04.660209 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.objects.instance [None req-01adda1c-f2f4-410b-97e5-07b61bc93094 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lazy-loading 'fault' on Instance uuid 730816fc-0c43-43e3-ab6e-e7f324e403d7 {{(pid=127565) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 00:59:04.709961 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-01adda1c-f2f4-410b-97e5-07b61bc93094 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:04.735245 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-01adda1c-f2f4-410b-97e5-07b61bc93094 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 200 len: 1327 microversion: 2.1 time: 0.106785 Aug 26 00:59:04.735245 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 323/647] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:59:04 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 1327 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:59:05.745079 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-8d03ddcf-cb1d-4963-9d67-26e299bf8224 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:05.745791 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-8d03ddcf-cb1d-4963-9d67-26e299bf8224 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:05.752086 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8d03ddcf-cb1d-4963-9d67-26e299bf8224 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:05.753195 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8d03ddcf-cb1d-4963-9d67-26e299bf8224 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:05.753633 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8d03ddcf-cb1d-4963-9d67-26e299bf8224 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:05.754322 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8d03ddcf-cb1d-4963-9d67-26e299bf8224 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:05.754779 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8d03ddcf-cb1d-4963-9d67-26e299bf8224 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:05.755283 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8d03ddcf-cb1d-4963-9d67-26e299bf8224 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:05.768709 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.wsgi [None req-8d03ddcf-cb1d-4963-9d67-26e299bf8224 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] HTTP exception thrown: Instance 730816fc-0c43-43e3-ab6e-e7f324e403d7 could not be found. Aug 26 00:59:05.770315 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-8d03ddcf-cb1d-4963-9d67-26e299bf8224 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Request method failure captured: Aug 26 00:59:05.770315 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: request: GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 HTTP/1.1 Aug 26 00:59:05.770315 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Accept: application/json Aug 26 00:59:05.770315 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Accept-Encoding: identity Aug 26 00:59:05.770315 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Connection: close Aug 26 00:59:05.770315 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Content-Length: 0 Aug 26 00:59:05.770315 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Content-Type: application/json Aug 26 00:59:05.770315 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Host: 10.222.0.59 Aug 26 00:59:05.770315 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Openstack-System-Scope: None Aug 26 00:59:05.770315 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: User-Agent: python-urllib3/1.26.11 Aug 26 00:59:05.770315 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Auth-Token: gAAAAABjCBmiJo3kHvT10T9Jjy1jBOSn7Bvzod408w2BCSd4FzzPtblMjSj90SuE4WhMVZE2OrkiKwE92EB5k_lvN938POeSncFplvwObTb9e_H71QzgJINEFj-VDMGTlVcWf_-YnYu6U7ZMq5okhfSfjxKfk0TZV25UNGIJCVy-wTX5xriWOMY Aug 26 00:59:05.770315 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Domain-Id: None Aug 26 00:59:05.770315 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Domain-Name: None Aug 26 00:59:05.770315 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Identity-Status: Confirmed Aug 26 00:59:05.770315 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Is-Admin-Project: True Aug 26 00:59:05.770315 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Domain-Id: default Aug 26 00:59:05.770315 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Domain-Name: Default Aug 26 00:59:05.770315 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Id: 5219060f4c184521919b017e8435eca5 Aug 26 00:59:05.770315 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Name: tempest-AttachVolumeTestJSON-921770591 Aug 26 00:59:05.770315 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Role: reader,member Aug 26 00:59:05.770315 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Roles: reader,member Aug 26 00:59:05.772012 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5219060f4c184521919b017e8435eca5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5219060f4c184521919b017e8435eca5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5219060f4c184521919b017e8435eca5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5219060f4c184521919b017e8435eca5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 00:59:05.772012 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant: tempest-AttachVolumeTestJSON-921770591 Aug 26 00:59:05.772012 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant-Id: 5219060f4c184521919b017e8435eca5 Aug 26 00:59:05.772012 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant-Name: tempest-AttachVolumeTestJSON-921770591 Aug 26 00:59:05.772012 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User: tempest-AttachVolumeTestJSON-921770591-project Aug 26 00:59:05.772012 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Domain-Id: default Aug 26 00:59:05.772012 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Domain-Name: Default Aug 26 00:59:05.772012 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Id: 0175a2b440704d51aa14607a2e20e36a Aug 26 00:59:05.772012 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Name: tempest-AttachVolumeTestJSON-921770591-project Aug 26 00:59:05.772012 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: method: > Aug 26 00:59:05.772012 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: exception: Instance 730816fc-0c43-43e3-ab6e-e7f324e403d7 could not be found. Aug 26 00:59:05.772012 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: action_args: {'id': '730816fc-0c43-43e3-ab6e-e7f324e403d7'} Aug 26 00:59:05.772978 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 00:59:05.772978 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:59:05.772978 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 00:59:05.772978 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 00:59:05.772978 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 00:59:05.772978 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 00:59:05.772978 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 00:59:05.772978 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 00:59:05.772978 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 00:59:05.772978 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 00:59:05.772978 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 730816fc-0c43-43e3-ab6e-e7f324e403d7 could not be found. Aug 26 00:59:05.772978 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 00:59:05.772978 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 00:59:05.772978 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 00:59:05.772978 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:59:05.772978 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 00:59:05.772978 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 00:59:05.772978 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 00:59:05.772978 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 00:59:05.772978 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 00:59:05.774557 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 00:59:05.774557 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 00:59:05.774557 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 00:59:05.774557 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 00:59:05.774557 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 00:59:05.774557 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 00:59:05.774557 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 00:59:05.774557 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 730816fc-0c43-43e3-ab6e-e7f324e403d7 could not be found. Aug 26 00:59:05.774557 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 00:59:05.774557 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 00:59:05.774557 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 00:59:05.774557 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:59:05.774557 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 00:59:05.774557 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 00:59:05.774557 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 00:59:05.774557 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 00:59:05.774557 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 730816fc-0c43-43e3-ab6e-e7f324e403d7 could not be found. Aug 26 00:59:05.774557 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 00:59:05.775879 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-8d03ddcf-cb1d-4963-9d67-26e299bf8224 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Returning 404 to user: Instance 730816fc-0c43-43e3-ab6e-e7f324e403d7 could not be found. {{(pid=127564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 00:59:05.775879 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-8d03ddcf-cb1d-4963-9d67-26e299bf8224 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 404 len: 111 microversion: 2.1 time: 0.031412 Aug 26 00:59:05.775879 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 325/648] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:59:05 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 00:59:05.784624 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-e4db3690-511d-4a48-a700-298897640688 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '.version_select at 0x7f8a92ec1040>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:05.834749 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-e4db3690-511d-4a48-a700-298897640688 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1794758417" status: 202 len: 0 microversion: 2.1 time: 0.053979 Aug 26 00:59:05.835338 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 324/649] 10.222.0.59 () {58 vars in 1221 bytes} [Fri Aug 26 00:59:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1794758417 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 00:59:06.560443 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-6b65a646-6881-4712-bbae-5ea4b318a581 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Action: 'create', calling method: .version_select at 0x7f8a92f02af0>, body: {"keypair": {"name": "tempest-keypair-165489234", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrdiZP4vXV9T01H13uWNKRTDslGqUowzDyTvpW4nUxytQJBI8v7DIvX3DnTw79T9H3dxUm1NZVPAgXVK/YGJUvVtY7TZzcV9Y+7VNHbZxjIjCHGoo3HBmjIhHAwIsaAcw=="}} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:59:06.575394 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.quota [None req-6b65a646-6881-4712-bbae-5ea4b318a581 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Getting quotas for project 5219060f4c184521919b017e8435eca5. Resources: {'key_pairs'} {{(pid=127564) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 00:59:06.579210 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.quota [None req-6b65a646-6881-4712-bbae-5ea4b318a581 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Getting quotas for user 0175a2b440704d51aa14607a2e20e36a and project 5219060f4c184521919b017e8435eca5. Resources: {'key_pairs'} {{(pid=127564) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 00:59:06.663973 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-6b65a646-6881-4712-bbae-5ea4b318a581 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.107062 Aug 26 00:59:06.664586 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 326/650] 10.222.0.59 () {60 vars in 1159 bytes} [Fri Aug 26 00:59:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:59:08.726443 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-c5a66ba7-51f7-4418-b504-9bb9e956a2ce tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-30548679", "imageRef": "ef60327f-6e0c-4f85-8db9-6f6e8968fe9c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a7f4c88d-45f2-48d0-b1db-d03d08216bf5"}], "security_groups": [{"name": "tempest-securitygroup--2092443180"}], "key_name": "tempest-keypair-165489234", "user_data": "}} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:59:08.834147 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.network.neutron [None req-c5a66ba7-51f7-4418-b504-9bb9e956a2ce tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] validate_networks() for [('a7f4c88d-45f2-48d0-b1db-d03d08216bf5', None, None, None, None, None)] {{(pid=127565) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 00:59:09.248603 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.virt.hardware [None req-c5a66ba7-51f7-4418-b504-9bb9e956a2ce tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Flavor limits 0:0:0 {{(pid=127565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 00:59:09.249036 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.virt.hardware [None req-c5a66ba7-51f7-4418-b504-9bb9e956a2ce tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Image limits 0:0:0 {{(pid=127565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 00:59:09.249507 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.virt.hardware [None req-c5a66ba7-51f7-4418-b504-9bb9e956a2ce tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Flavor pref 0:0:0 {{(pid=127565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 00:59:09.249914 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.virt.hardware [None req-c5a66ba7-51f7-4418-b504-9bb9e956a2ce tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Image pref 0:0:0 {{(pid=127565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 00:59:09.250352 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.virt.hardware [None req-c5a66ba7-51f7-4418-b504-9bb9e956a2ce tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 00:59:09.259597 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c5a66ba7-51f7-4418-b504-9bb9e956a2ce tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:09.260070 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c5a66ba7-51f7-4418-b504-9bb9e956a2ce tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:09.260535 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c5a66ba7-51f7-4418-b504-9bb9e956a2ce tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:09.261252 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c5a66ba7-51f7-4418-b504-9bb9e956a2ce tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:09.261702 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c5a66ba7-51f7-4418-b504-9bb9e956a2ce tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:09.262157 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c5a66ba7-51f7-4418-b504-9bb9e956a2ce tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:09.278764 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.quota [None req-c5a66ba7-51f7-4418-b504-9bb9e956a2ce tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Getting quotas for project 5219060f4c184521919b017e8435eca5. Resources: {'instances', 'ram', 'cores'} {{(pid=127565) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 00:59:09.282701 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.quota [None req-c5a66ba7-51f7-4418-b504-9bb9e956a2ce tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Getting quotas for user 0175a2b440704d51aa14607a2e20e36a and project 5219060f4c184521919b017e8435eca5. Resources: {'instances', 'ram', 'cores'} {{(pid=127565) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 00:59:09.294129 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-c5a66ba7-51f7-4418-b504-9bb9e956a2ce tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Going to run 1 instances... {{(pid=127565) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 00:59:09.296362 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-c5a66ba7-51f7-4418-b504-9bb9e956a2ce tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 33bd7c7e-1f1c-4d78-9a79-142e4f5c3478] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ef60327f-6e0c-4f85-8db9-6f6e8968fe9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127565) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 00:59:09.413947 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-c5a66ba7-51f7-4418-b504-9bb9e956a2ce tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.692128 Aug 26 00:59:09.414585 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 325/651] 10.222.0.59 () {60 vars in 1147 bytes} [Fri Aug 26 00:59:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 00:59:09.425323 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-38f26834-a7e3-440b-b22b-33ced9a07939 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:09.425934 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-38f26834-a7e3-440b-b22b-33ced9a07939 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 33bd7c7e-1f1c-4d78-9a79-142e4f5c3478] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:09.482200 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-38f26834-a7e3-440b-b22b-33ced9a07939 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:09.489909 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-38f26834-a7e3-440b-b22b-33ced9a07939 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478" status: 200 len: 1235 microversion: 2.1 time: 0.068497 Aug 26 00:59:09.493048 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 327/652] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:59:09 2022] GET /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478 => generated 1235 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:59:10.510165 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-af7c315d-10b9-42b7-805f-29a436770bfb tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:10.510771 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-af7c315d-10b9-42b7-805f-29a436770bfb tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 33bd7c7e-1f1c-4d78-9a79-142e4f5c3478] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:10.516836 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-af7c315d-10b9-42b7-805f-29a436770bfb tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:10.517335 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-af7c315d-10b9-42b7-805f-29a436770bfb tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:10.517758 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-af7c315d-10b9-42b7-805f-29a436770bfb tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:10.519038 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-af7c315d-10b9-42b7-805f-29a436770bfb tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:10.519528 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-af7c315d-10b9-42b7-805f-29a436770bfb tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:10.523076 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-af7c315d-10b9-42b7-805f-29a436770bfb tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:10.583028 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-af7c315d-10b9-42b7-805f-29a436770bfb tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:10.590690 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-af7c315d-10b9-42b7-805f-29a436770bfb tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478" status: 200 len: 1239 microversion: 2.1 time: 0.084871 Aug 26 00:59:10.591250 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 326/653] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:59:10 2022] GET /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478 => generated 1239 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:59:11.612223 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-6cc2781a-0eee-43f1-ba9b-0573f743852e tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:11.612876 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-6cc2781a-0eee-43f1-ba9b-0573f743852e tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 33bd7c7e-1f1c-4d78-9a79-142e4f5c3478] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:11.619145 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6cc2781a-0eee-43f1-ba9b-0573f743852e tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:11.619629 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6cc2781a-0eee-43f1-ba9b-0573f743852e tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:11.620071 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6cc2781a-0eee-43f1-ba9b-0573f743852e tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:11.620794 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6cc2781a-0eee-43f1-ba9b-0573f743852e tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:11.621249 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6cc2781a-0eee-43f1-ba9b-0573f743852e tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:11.621681 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6cc2781a-0eee-43f1-ba9b-0573f743852e tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:11.688721 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-6cc2781a-0eee-43f1-ba9b-0573f743852e tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:11.697500 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-6cc2781a-0eee-43f1-ba9b-0573f743852e tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478" status: 200 len: 1295 microversion: 2.1 time: 0.089586 Aug 26 00:59:11.698347 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 328/654] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:59:11 2022] GET /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478 => generated 1295 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:59:12.719443 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-c200d14b-36ad-406c-a62a-39bd7754e72d tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:12.720053 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-c200d14b-36ad-406c-a62a-39bd7754e72d tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 33bd7c7e-1f1c-4d78-9a79-142e4f5c3478] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:12.728727 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c200d14b-36ad-406c-a62a-39bd7754e72d tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:12.729210 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c200d14b-36ad-406c-a62a-39bd7754e72d tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:12.729640 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c200d14b-36ad-406c-a62a-39bd7754e72d tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:12.730331 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c200d14b-36ad-406c-a62a-39bd7754e72d tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:12.730775 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c200d14b-36ad-406c-a62a-39bd7754e72d tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:12.731437 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c200d14b-36ad-406c-a62a-39bd7754e72d tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:12.961226 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-c200d14b-36ad-406c-a62a-39bd7754e72d tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:12.969461 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-c200d14b-36ad-406c-a62a-39bd7754e72d tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478" status: 200 len: 1361 microversion: 2.1 time: 0.254102 Aug 26 00:59:12.970375 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 327/655] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:59:12 2022] GET /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478 => generated 1361 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:59:13.464581 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [req-bd334b28-5e74-49b7-9636-5bcb6aa13ff9 req-13db4d54-847d-4edf-bc70-6f46dc80a06c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33bd7c7e-1f1c-4d78-9a79-142e4f5c3478", "tag": "f8e66d90-cfee-41e2-bd68-668434bd3c87"}]} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:59:13.474693 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-bd334b28-5e74-49b7-9636-5bcb6aa13ff9 req-13db4d54-847d-4edf-bc70-6f46dc80a06c service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:13.475169 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-bd334b28-5e74-49b7-9636-5bcb6aa13ff9 req-13db4d54-847d-4edf-bc70-6f46dc80a06c service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:13.475596 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-bd334b28-5e74-49b7-9636-5bcb6aa13ff9 req-13db4d54-847d-4edf-bc70-6f46dc80a06c service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:13.486946 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.compute.server_external_events [req-bd334b28-5e74-49b7-9636-5bcb6aa13ff9 req-13db4d54-847d-4edf-bc70-6f46dc80a06c service nova] Creating event network-changed:f8e66d90-cfee-41e2-bd68-668434bd3c87 for instance 33bd7c7e-1f1c-4d78-9a79-142e4f5c3478 on hv-cinder-83538 Aug 26 00:59:13.492536 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [req-bd334b28-5e74-49b7-9636-5bcb6aa13ff9 req-13db4d54-847d-4edf-bc70-6f46dc80a06c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098202 Aug 26 00:59:13.493129 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 329/656] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 00:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 00:59:13.990814 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-a0cdc96c-4877-4c43-b248-68a8c4432cae tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:13.991361 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-a0cdc96c-4877-4c43-b248-68a8c4432cae tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 33bd7c7e-1f1c-4d78-9a79-142e4f5c3478] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:13.998104 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a0cdc96c-4877-4c43-b248-68a8c4432cae tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:13.998583 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a0cdc96c-4877-4c43-b248-68a8c4432cae tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:13.999019 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a0cdc96c-4877-4c43-b248-68a8c4432cae tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:13.999703 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a0cdc96c-4877-4c43-b248-68a8c4432cae tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:14.000151 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a0cdc96c-4877-4c43-b248-68a8c4432cae tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:14.000614 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a0cdc96c-4877-4c43-b248-68a8c4432cae tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:14.124718 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-a0cdc96c-4877-4c43-b248-68a8c4432cae tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:14.132739 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-a0cdc96c-4877-4c43-b248-68a8c4432cae tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478" status: 200 len: 1361 microversion: 2.1 time: 0.145885 Aug 26 00:59:14.133297 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 328/657] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:59:13 2022] GET /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478 => generated 1361 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:59:15.154223 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-df14935a-5a4d-48b0-b4b8-97bd26b3874e tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:15.154951 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-df14935a-5a4d-48b0-b4b8-97bd26b3874e tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 33bd7c7e-1f1c-4d78-9a79-142e4f5c3478] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:15.161626 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-df14935a-5a4d-48b0-b4b8-97bd26b3874e tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:15.162115 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-df14935a-5a4d-48b0-b4b8-97bd26b3874e tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:15.162552 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-df14935a-5a4d-48b0-b4b8-97bd26b3874e tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:15.163247 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-df14935a-5a4d-48b0-b4b8-97bd26b3874e tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:15.163958 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-df14935a-5a4d-48b0-b4b8-97bd26b3874e tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:15.164381 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-df14935a-5a4d-48b0-b4b8-97bd26b3874e tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:15.310053 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-df14935a-5a4d-48b0-b4b8-97bd26b3874e tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:15.317614 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-df14935a-5a4d-48b0-b4b8-97bd26b3874e tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478" status: 200 len: 1361 microversion: 2.1 time: 0.167732 Aug 26 00:59:15.318169 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 330/658] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:59:15 2022] GET /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478 => generated 1361 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:59:16.338044 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-6a63f139-31ed-4d9d-a561-03e70add809b tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:16.338649 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-6a63f139-31ed-4d9d-a561-03e70add809b tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 33bd7c7e-1f1c-4d78-9a79-142e4f5c3478] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:16.345554 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6a63f139-31ed-4d9d-a561-03e70add809b tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:16.346105 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6a63f139-31ed-4d9d-a561-03e70add809b tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:16.347037 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6a63f139-31ed-4d9d-a561-03e70add809b tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:16.347723 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6a63f139-31ed-4d9d-a561-03e70add809b tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:16.348170 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6a63f139-31ed-4d9d-a561-03e70add809b tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:16.348632 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6a63f139-31ed-4d9d-a561-03e70add809b tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:16.480407 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-6a63f139-31ed-4d9d-a561-03e70add809b tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:16.488923 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-6a63f139-31ed-4d9d-a561-03e70add809b tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478" status: 200 len: 1361 microversion: 2.1 time: 0.154801 Aug 26 00:59:16.489477 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 329/659] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:59:16 2022] GET /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:59:17.509340 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-f86f3017-5918-4e95-9d19-e9a158d15cc2 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:17.509937 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-f86f3017-5918-4e95-9d19-e9a158d15cc2 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 33bd7c7e-1f1c-4d78-9a79-142e4f5c3478] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:17.515913 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f86f3017-5918-4e95-9d19-e9a158d15cc2 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:17.516388 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f86f3017-5918-4e95-9d19-e9a158d15cc2 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:17.516846 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f86f3017-5918-4e95-9d19-e9a158d15cc2 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:17.517521 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f86f3017-5918-4e95-9d19-e9a158d15cc2 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:17.517967 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f86f3017-5918-4e95-9d19-e9a158d15cc2 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:17.518384 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f86f3017-5918-4e95-9d19-e9a158d15cc2 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:17.642886 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-f86f3017-5918-4e95-9d19-e9a158d15cc2 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:17.650616 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-f86f3017-5918-4e95-9d19-e9a158d15cc2 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478" status: 200 len: 1361 microversion: 2.1 time: 0.145089 Aug 26 00:59:17.651178 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 331/660] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:59:17 2022] GET /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478 => generated 1361 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:59:18.245534 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [req-aeaf2018-777c-4ca2-9d84-770496b7b926 req-bd0be37f-5657-4673-8c3c-85dd8ef43e21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33bd7c7e-1f1c-4d78-9a79-142e4f5c3478", "name": "network-vif-plugged", "status": "completed", "tag": "f8e66d90-cfee-41e2-bd68-668434bd3c87"}]} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:59:18.255492 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-aeaf2018-777c-4ca2-9d84-770496b7b926 req-bd0be37f-5657-4673-8c3c-85dd8ef43e21 service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:18.258143 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-aeaf2018-777c-4ca2-9d84-770496b7b926 req-bd0be37f-5657-4673-8c3c-85dd8ef43e21 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:18.258143 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-aeaf2018-777c-4ca2-9d84-770496b7b926 req-bd0be37f-5657-4673-8c3c-85dd8ef43e21 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:18.266819 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.compute.server_external_events [req-aeaf2018-777c-4ca2-9d84-770496b7b926 req-bd0be37f-5657-4673-8c3c-85dd8ef43e21 service nova] Creating event network-vif-plugged:f8e66d90-cfee-41e2-bd68-668434bd3c87 for instance 33bd7c7e-1f1c-4d78-9a79-142e4f5c3478 on hv-cinder-83538 Aug 26 00:59:18.272452 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [req-aeaf2018-777c-4ca2-9d84-770496b7b926 req-bd0be37f-5657-4673-8c3c-85dd8ef43e21 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030706 Aug 26 00:59:18.273091 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 330/661] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 00:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:59:18.671549 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-81221dc0-cfcc-4d3c-8231-32bf8e748518 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:18.672415 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-81221dc0-cfcc-4d3c-8231-32bf8e748518 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 33bd7c7e-1f1c-4d78-9a79-142e4f5c3478] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:18.678377 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-81221dc0-cfcc-4d3c-8231-32bf8e748518 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:18.678873 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-81221dc0-cfcc-4d3c-8231-32bf8e748518 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:18.679285 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-81221dc0-cfcc-4d3c-8231-32bf8e748518 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:18.679998 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-81221dc0-cfcc-4d3c-8231-32bf8e748518 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:18.680443 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-81221dc0-cfcc-4d3c-8231-32bf8e748518 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:18.680885 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-81221dc0-cfcc-4d3c-8231-32bf8e748518 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:18.816432 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-81221dc0-cfcc-4d3c-8231-32bf8e748518 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:18.824203 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-81221dc0-cfcc-4d3c-8231-32bf8e748518 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478" status: 200 len: 1361 microversion: 2.1 time: 0.157066 Aug 26 00:59:18.824814 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 332/662] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:59:18 2022] GET /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:59:18.896456 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-b52fa310-41cf-43e5-af88-64eb6ffd8baa tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:18.897099 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-b52fa310-41cf-43e5-af88-64eb6ffd8baa tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:18.903854 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b52fa310-41cf-43e5-af88-64eb6ffd8baa tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:18.905862 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b52fa310-41cf-43e5-af88-64eb6ffd8baa tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:18.905862 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b52fa310-41cf-43e5-af88-64eb6ffd8baa tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:18.905862 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b52fa310-41cf-43e5-af88-64eb6ffd8baa tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:18.906147 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b52fa310-41cf-43e5-af88-64eb6ffd8baa tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:18.906491 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b52fa310-41cf-43e5-af88-64eb6ffd8baa tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:18.934308 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-b52fa310-41cf-43e5-af88-64eb6ffd8baa tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec/ips" status: 200 len: 153 microversion: 2.20 time: 0.095837 Aug 26 00:59:18.934308 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 331/663] 10.222.0.59 () {60 vars in 1289 bytes} [Fri Aug 26 00:59:18 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec/ips => generated 153 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 00:59:19.845438 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-b01152d3-a0e0-4fcd-a3c5-8e3a4eb71237 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:19.846077 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-b01152d3-a0e0-4fcd-a3c5-8e3a4eb71237 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 33bd7c7e-1f1c-4d78-9a79-142e4f5c3478] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:19.849616 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell0:SELECT=6 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:59:19.853021 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b01152d3-a0e0-4fcd-a3c5-8e3a4eb71237 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:19.853502 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b01152d3-a0e0-4fcd-a3c5-8e3a4eb71237 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:19.853928 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b01152d3-a0e0-4fcd-a3c5-8e3a4eb71237 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:19.854637 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b01152d3-a0e0-4fcd-a3c5-8e3a4eb71237 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:19.855083 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b01152d3-a0e0-4fcd-a3c5-8e3a4eb71237 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:19.855497 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b01152d3-a0e0-4fcd-a3c5-8e3a4eb71237 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:19.988125 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-b01152d3-a0e0-4fcd-a3c5-8e3a4eb71237 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:19.991620 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-b01152d3-a0e0-4fcd-a3c5-8e3a4eb71237 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478" status: 200 len: 1361 microversion: 2.1 time: 0.150014 Aug 26 00:59:19.992185 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 333/664] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:59:19 2022] GET /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478 => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:59:21.012899 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-330a5b16-a3e0-43c1-8513-5693a3ee5508 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:21.013507 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-330a5b16-a3e0-43c1-8513-5693a3ee5508 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 33bd7c7e-1f1c-4d78-9a79-142e4f5c3478] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:21.015910 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell0:SELECT=2 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:59:21.016623 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell0:SELECT=6 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:59:21.021425 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-330a5b16-a3e0-43c1-8513-5693a3ee5508 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:21.021907 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-330a5b16-a3e0-43c1-8513-5693a3ee5508 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:21.022344 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-330a5b16-a3e0-43c1-8513-5693a3ee5508 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:21.023029 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-330a5b16-a3e0-43c1-8513-5693a3ee5508 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:21.023482 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-330a5b16-a3e0-43c1-8513-5693a3ee5508 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:21.023906 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-330a5b16-a3e0-43c1-8513-5693a3ee5508 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:21.154446 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-330a5b16-a3e0-43c1-8513-5693a3ee5508 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:21.162753 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-330a5b16-a3e0-43c1-8513-5693a3ee5508 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478" status: 200 len: 1548 microversion: 2.1 time: 0.153870 Aug 26 00:59:21.163313 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 332/665] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:59:21 2022] GET /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478 => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:59:21.183233 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-c15ebb07-2040-4963-8fc7-45070a886f63 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:21.183713 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-c15ebb07-2040-4963-8fc7-45070a886f63 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 33bd7c7e-1f1c-4d78-9a79-142e4f5c3478] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:21.189705 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c15ebb07-2040-4963-8fc7-45070a886f63 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:21.190714 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c15ebb07-2040-4963-8fc7-45070a886f63 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:21.191152 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c15ebb07-2040-4963-8fc7-45070a886f63 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:21.191839 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c15ebb07-2040-4963-8fc7-45070a886f63 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:21.192294 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c15ebb07-2040-4963-8fc7-45070a886f63 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:21.192748 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c15ebb07-2040-4963-8fc7-45070a886f63 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:21.270472 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-c15ebb07-2040-4963-8fc7-45070a886f63 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091063 Aug 26 00:59:21.271093 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 334/666] 10.222.0.59 () {58 vars in 1275 bytes} [Fri Aug 26 00:59:21 2022] GET /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:59:21.633245 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-08cc6337-2f67-488d-9fa0-6b1b9bfc7a51 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:59:21.633800 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-08cc6337-2f67-488d-9fa0-6b1b9bfc7a51 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:21.639658 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-08cc6337-2f67-488d-9fa0-6b1b9bfc7a51 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:21.640135 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-08cc6337-2f67-488d-9fa0-6b1b9bfc7a51 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:21.640598 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-08cc6337-2f67-488d-9fa0-6b1b9bfc7a51 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:21.641286 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-08cc6337-2f67-488d-9fa0-6b1b9bfc7a51 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:21.641749 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-08cc6337-2f67-488d-9fa0-6b1b9bfc7a51 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:21.642152 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-08cc6337-2f67-488d-9fa0-6b1b9bfc7a51 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:21.665755 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.objects.instance [None req-08cc6337-2f67-488d-9fa0-6b1b9bfc7a51 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lazy-loading 'flavor' on Instance uuid 8af18a63-5c10-4530-9072-6ca92223b8ec {{(pid=127565) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 00:59:22.084745 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-08cc6337-2f67-488d-9fa0-6b1b9bfc7a51 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "POST /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec/action" status: 202 len: 0 microversion: 2.20 time: 0.455285 Aug 26 00:59:22.085383 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 333/667] 10.222.0.59 () {62 vars in 1319 bytes} [Fri Aug 26 00:59:21 2022] POST /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec/action => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 26 00:59:22.094048 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-0e102a3d-ba37-4a68-a79f-6c86f7cc514b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:22.094653 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-0e102a3d-ba37-4a68-a79f-6c86f7cc514b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:22.102401 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-0e102a3d-ba37-4a68-a79f-6c86f7cc514b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:22.102882 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-0e102a3d-ba37-4a68-a79f-6c86f7cc514b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:22.103318 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-0e102a3d-ba37-4a68-a79f-6c86f7cc514b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:22.104039 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-0e102a3d-ba37-4a68-a79f-6c86f7cc514b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:22.104569 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-0e102a3d-ba37-4a68-a79f-6c86f7cc514b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:22.104926 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-0e102a3d-ba37-4a68-a79f-6c86f7cc514b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:22.563381 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-0e102a3d-ba37-4a68-a79f-6c86f7cc514b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:22.572927 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-0e102a3d-ba37-4a68-a79f-6c86f7cc514b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:22.574471 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-0e102a3d-ba37-4a68-a79f-6c86f7cc514b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:22.575726 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-0e102a3d-ba37-4a68-a79f-6c86f7cc514b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 200 len: 1723 microversion: 2.20 time: 0.485986 Aug 26 00:59:22.576778 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 335/668] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:59:22 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 1723 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:59:22.618169 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [req-c35d3059-9754-4da8-bad9-a3573eb557a3 req-20be87be-4899-4dc5-a124-0e523827dbf1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33bd7c7e-1f1c-4d78-9a79-142e4f5c3478", "tag": "f8e66d90-cfee-41e2-bd68-668434bd3c87"}]} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:59:22.628789 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-c35d3059-9754-4da8-bad9-a3573eb557a3 req-20be87be-4899-4dc5-a124-0e523827dbf1 service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:22.629266 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-c35d3059-9754-4da8-bad9-a3573eb557a3 req-20be87be-4899-4dc5-a124-0e523827dbf1 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:22.629705 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-c35d3059-9754-4da8-bad9-a3573eb557a3 req-20be87be-4899-4dc5-a124-0e523827dbf1 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:22.640141 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.compute.server_external_events [req-c35d3059-9754-4da8-bad9-a3573eb557a3 req-20be87be-4899-4dc5-a124-0e523827dbf1 service nova] Creating event network-changed:f8e66d90-cfee-41e2-bd68-668434bd3c87 for instance 33bd7c7e-1f1c-4d78-9a79-142e4f5c3478 on hv-cinder-83538 Aug 26 00:59:22.645176 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [req-c35d3059-9754-4da8-bad9-a3573eb557a3 req-20be87be-4899-4dc5-a124-0e523827dbf1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086536 Aug 26 00:59:22.645773 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 334/669] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 00:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 00:59:23.598888 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-23394186-b355-4852-b2fb-af8d898bd2e1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:23.599502 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-23394186-b355-4852-b2fb-af8d898bd2e1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:23.605555 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-23394186-b355-4852-b2fb-af8d898bd2e1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:23.606047 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-23394186-b355-4852-b2fb-af8d898bd2e1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:23.606626 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-23394186-b355-4852-b2fb-af8d898bd2e1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:23.607318 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-23394186-b355-4852-b2fb-af8d898bd2e1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:23.607771 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-23394186-b355-4852-b2fb-af8d898bd2e1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:23.608221 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-23394186-b355-4852-b2fb-af8d898bd2e1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:23.732955 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-23394186-b355-4852-b2fb-af8d898bd2e1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:23.741650 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-23394186-b355-4852-b2fb-af8d898bd2e1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:23.743078 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-23394186-b355-4852-b2fb-af8d898bd2e1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:23.744220 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-23394186-b355-4852-b2fb-af8d898bd2e1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 200 len: 1723 microversion: 2.20 time: 0.149362 Aug 26 00:59:23.744814 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 336/670] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:59:23 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:59:24.770067 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-9c3e2105-261b-4598-af2b-186cbfdfdd94 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:24.770750 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-9c3e2105-261b-4598-af2b-186cbfdfdd94 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:24.777436 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9c3e2105-261b-4598-af2b-186cbfdfdd94 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:24.777908 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9c3e2105-261b-4598-af2b-186cbfdfdd94 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:24.778332 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9c3e2105-261b-4598-af2b-186cbfdfdd94 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:24.779115 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9c3e2105-261b-4598-af2b-186cbfdfdd94 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:24.779571 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9c3e2105-261b-4598-af2b-186cbfdfdd94 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:24.779990 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9c3e2105-261b-4598-af2b-186cbfdfdd94 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:24.914120 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-9c3e2105-261b-4598-af2b-186cbfdfdd94 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:24.917684 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:59:24.922821 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-9c3e2105-261b-4598-af2b-186cbfdfdd94 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:24.924328 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-9c3e2105-261b-4598-af2b-186cbfdfdd94 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:24.925573 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-9c3e2105-261b-4598-af2b-186cbfdfdd94 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 200 len: 1723 microversion: 2.20 time: 0.160443 Aug 26 00:59:24.933992 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 335/671] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:59:24 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:59:25.417976 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-c9232d2b-c537-4e68-b045-2bcaa0a294a3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:25.418491 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-c9232d2b-c537-4e68-b045-2bcaa0a294a3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:25.425001 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c9232d2b-c537-4e68-b045-2bcaa0a294a3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:25.425483 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c9232d2b-c537-4e68-b045-2bcaa0a294a3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:25.425917 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c9232d2b-c537-4e68-b045-2bcaa0a294a3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:25.426609 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c9232d2b-c537-4e68-b045-2bcaa0a294a3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:25.427063 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c9232d2b-c537-4e68-b045-2bcaa0a294a3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:25.427490 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c9232d2b-c537-4e68-b045-2bcaa0a294a3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:25.506522 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.objects.instance [None req-c9232d2b-c537-4e68-b045-2bcaa0a294a3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lazy-loading 'services' on Instance uuid 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd {{(pid=127564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 00:59:25.798713 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-c9232d2b-c537-4e68-b045-2bcaa0a294a3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "DELETE /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd/os-volume_attachments/40d6b3f6-fcb9-43af-acbd-fff8f85abb20" status: 202 len: 0 microversion: 2.1 time: 0.384421 Aug 26 00:59:25.799870 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 337/672] 10.222.0.59 () {58 vars in 1416 bytes} [Fri Aug 26 00:59:25 2022] DELETE /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd/os-volume_attachments/40d6b3f6-fcb9-43af-acbd-fff8f85abb20 => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 00:59:25.808680 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-e058a9ed-7011-439e-a918-250cde919c74 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:25.810899 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-e058a9ed-7011-439e-a918-250cde919c74 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:25.818443 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e058a9ed-7011-439e-a918-250cde919c74 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:25.818929 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e058a9ed-7011-439e-a918-250cde919c74 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:25.819365 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e058a9ed-7011-439e-a918-250cde919c74 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:25.820056 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e058a9ed-7011-439e-a918-250cde919c74 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:25.820595 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e058a9ed-7011-439e-a918-250cde919c74 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:25.821021 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e058a9ed-7011-439e-a918-250cde919c74 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:25.851840 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-e058a9ed-7011-439e-a918-250cde919c74 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047349 Aug 26 00:59:25.852398 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 336/673] 10.222.0.59 () {58 vars in 1302 bytes} [Fri Aug 26 00:59:25 2022] GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:59:25.949649 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-a6e44b9e-0174-4acd-8c9d-5ce5b7ff81e4 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:25.950340 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-a6e44b9e-0174-4acd-8c9d-5ce5b7ff81e4 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:25.957290 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a6e44b9e-0174-4acd-8c9d-5ce5b7ff81e4 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:25.957777 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a6e44b9e-0174-4acd-8c9d-5ce5b7ff81e4 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:25.958292 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a6e44b9e-0174-4acd-8c9d-5ce5b7ff81e4 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:25.958903 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a6e44b9e-0174-4acd-8c9d-5ce5b7ff81e4 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:25.959354 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a6e44b9e-0174-4acd-8c9d-5ce5b7ff81e4 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:25.959793 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a6e44b9e-0174-4acd-8c9d-5ce5b7ff81e4 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:26.088635 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-a6e44b9e-0174-4acd-8c9d-5ce5b7ff81e4 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:26.097156 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-a6e44b9e-0174-4acd-8c9d-5ce5b7ff81e4 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:26.098565 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-a6e44b9e-0174-4acd-8c9d-5ce5b7ff81e4 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:26.099702 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-a6e44b9e-0174-4acd-8c9d-5ce5b7ff81e4 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 200 len: 1723 microversion: 2.20 time: 0.154279 Aug 26 00:59:26.100260 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 338/674] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:59:25 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:59:26.864616 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-b99819f7-abbc-4a96-8f42-8acd335e237d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:26.866793 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-b99819f7-abbc-4a96-8f42-8acd335e237d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:26.873879 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b99819f7-abbc-4a96-8f42-8acd335e237d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:26.874357 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b99819f7-abbc-4a96-8f42-8acd335e237d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:26.874792 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b99819f7-abbc-4a96-8f42-8acd335e237d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:26.875471 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b99819f7-abbc-4a96-8f42-8acd335e237d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:26.875916 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b99819f7-abbc-4a96-8f42-8acd335e237d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:26.876336 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b99819f7-abbc-4a96-8f42-8acd335e237d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:26.907073 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-b99819f7-abbc-4a96-8f42-8acd335e237d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046450 Aug 26 00:59:26.907635 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 337/675] 10.222.0.59 () {58 vars in 1302 bytes} [Fri Aug 26 00:59:26 2022] GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:59:27.122213 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-411bf40d-ba2b-4e76-9362-74fbd5d3be26 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:27.122808 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-411bf40d-ba2b-4e76-9362-74fbd5d3be26 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:27.129272 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-411bf40d-ba2b-4e76-9362-74fbd5d3be26 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:27.129781 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-411bf40d-ba2b-4e76-9362-74fbd5d3be26 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:27.130223 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-411bf40d-ba2b-4e76-9362-74fbd5d3be26 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:27.130910 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-411bf40d-ba2b-4e76-9362-74fbd5d3be26 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:27.131364 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-411bf40d-ba2b-4e76-9362-74fbd5d3be26 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:27.131792 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-411bf40d-ba2b-4e76-9362-74fbd5d3be26 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:27.268803 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-411bf40d-ba2b-4e76-9362-74fbd5d3be26 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:27.276878 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-411bf40d-ba2b-4e76-9362-74fbd5d3be26 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:27.278297 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-411bf40d-ba2b-4e76-9362-74fbd5d3be26 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:27.279440 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-411bf40d-ba2b-4e76-9362-74fbd5d3be26 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 200 len: 1723 microversion: 2.20 time: 0.161134 Aug 26 00:59:27.279992 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 339/676] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:59:27 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:59:27.919543 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-31b4b7ce-d21e-402a-b796-006f8eec0988 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:27.921734 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-31b4b7ce-d21e-402a-b796-006f8eec0988 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:27.928822 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-31b4b7ce-d21e-402a-b796-006f8eec0988 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:27.932465 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-31b4b7ce-d21e-402a-b796-006f8eec0988 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:27.932465 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-31b4b7ce-d21e-402a-b796-006f8eec0988 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:27.932465 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-31b4b7ce-d21e-402a-b796-006f8eec0988 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:27.932465 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-31b4b7ce-d21e-402a-b796-006f8eec0988 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:27.932900 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-31b4b7ce-d21e-402a-b796-006f8eec0988 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:27.965421 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-31b4b7ce-d21e-402a-b796-006f8eec0988 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049827 Aug 26 00:59:27.965978 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 338/677] 10.222.0.59 () {58 vars in 1302 bytes} [Fri Aug 26 00:59:27 2022] GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 00:59:28.041985 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-e9eb41a1-5424-4b41-be94-b56e8011f085 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:28.042480 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-e9eb41a1-5424-4b41-be94-b56e8011f085 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:28.048769 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e9eb41a1-5424-4b41-be94-b56e8011f085 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:28.049257 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e9eb41a1-5424-4b41-be94-b56e8011f085 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:28.049732 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e9eb41a1-5424-4b41-be94-b56e8011f085 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:28.050433 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e9eb41a1-5424-4b41-be94-b56e8011f085 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:28.050892 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e9eb41a1-5424-4b41-be94-b56e8011f085 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:28.051314 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e9eb41a1-5424-4b41-be94-b56e8011f085 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:28.075765 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-e9eb41a1-5424-4b41-be94-b56e8011f085 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Going to try to terminate instance {{(pid=127564) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 00:59:28.090479 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:59:28.302178 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-2521b6a4-cf95-4d7e-8974-e662000c0c38 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:28.302731 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-2521b6a4-cf95-4d7e-8974-e662000c0c38 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:28.308586 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2521b6a4-cf95-4d7e-8974-e662000c0c38 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:28.309059 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2521b6a4-cf95-4d7e-8974-e662000c0c38 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:28.309494 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2521b6a4-cf95-4d7e-8974-e662000c0c38 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:28.310176 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2521b6a4-cf95-4d7e-8974-e662000c0c38 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:28.310628 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2521b6a4-cf95-4d7e-8974-e662000c0c38 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:28.311108 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2521b6a4-cf95-4d7e-8974-e662000c0c38 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:28.365154 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-e9eb41a1-5424-4b41-be94-b56e8011f085 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "DELETE /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd" status: 204 len: 0 microversion: 2.1 time: 0.326882 Aug 26 00:59:28.365833 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 340/678] 10.222.0.59 () {58 vars in 1239 bytes} [Fri Aug 26 00:59:28 2022] DELETE /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 00:59:28.374030 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-c900de28-067a-4fd7-94db-a84a05ac7455 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:28.374729 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-c900de28-067a-4fd7-94db-a84a05ac7455 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:28.381489 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c900de28-067a-4fd7-94db-a84a05ac7455 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:28.381982 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c900de28-067a-4fd7-94db-a84a05ac7455 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:28.382424 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c900de28-067a-4fd7-94db-a84a05ac7455 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:28.383119 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c900de28-067a-4fd7-94db-a84a05ac7455 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:28.383578 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c900de28-067a-4fd7-94db-a84a05ac7455 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:28.384006 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c900de28-067a-4fd7-94db-a84a05ac7455 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:28.443751 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-2521b6a4-cf95-4d7e-8974-e662000c0c38 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:28.451872 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-2521b6a4-cf95-4d7e-8974-e662000c0c38 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:28.453872 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-2521b6a4-cf95-4d7e-8974-e662000c0c38 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:28.454465 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-2521b6a4-cf95-4d7e-8974-e662000c0c38 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 200 len: 1723 microversion: 2.20 time: 0.156374 Aug 26 00:59:28.455270 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 339/679] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:59:28 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 00:59:28.459546 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-1fa30cc0-d004-4d0e-b8b4-d97001c991f4 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:28.460038 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-1fa30cc0-d004-4d0e-b8b4-d97001c991f4 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: cc9ceee0-65b5-48be-8dcc-7ec2a992f72d] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:28.466071 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1fa30cc0-d004-4d0e-b8b4-d97001c991f4 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:28.466558 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1fa30cc0-d004-4d0e-b8b4-d97001c991f4 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:28.466986 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1fa30cc0-d004-4d0e-b8b4-d97001c991f4 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:28.467670 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1fa30cc0-d004-4d0e-b8b4-d97001c991f4 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:28.468179 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1fa30cc0-d004-4d0e-b8b4-d97001c991f4 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:28.468621 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1fa30cc0-d004-4d0e-b8b4-d97001c991f4 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:28.495231 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-1fa30cc0-d004-4d0e-b8b4-d97001c991f4 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: cc9ceee0-65b5-48be-8dcc-7ec2a992f72d] Going to try to terminate instance {{(pid=127565) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 00:59:28.519699 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-c900de28-067a-4fd7-94db-a84a05ac7455 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:28.527487 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-c900de28-067a-4fd7-94db-a84a05ac7455 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd" status: 200 len: 1691 microversion: 2.1 time: 0.157488 Aug 26 00:59:28.528046 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 341/680] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:59:28 2022] GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd => generated 1691 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:59:28.764661 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-1fa30cc0-d004-4d0e-b8b4-d97001c991f4 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "DELETE /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d" status: 204 len: 0 microversion: 2.1 time: 0.308324 Aug 26 00:59:28.765275 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 340/681] 10.222.0.59 () {58 vars in 1239 bytes} [Fri Aug 26 00:59:28 2022] DELETE /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 00:59:28.774227 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-5e9efd20-f671-4b3e-9a60-1fc7c3fd3a1f tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:28.777249 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-5e9efd20-f671-4b3e-9a60-1fc7c3fd3a1f tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: cc9ceee0-65b5-48be-8dcc-7ec2a992f72d] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:28.780836 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5e9efd20-f671-4b3e-9a60-1fc7c3fd3a1f tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:28.781309 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5e9efd20-f671-4b3e-9a60-1fc7c3fd3a1f tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:28.781736 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5e9efd20-f671-4b3e-9a60-1fc7c3fd3a1f tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:28.782418 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5e9efd20-f671-4b3e-9a60-1fc7c3fd3a1f tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:28.782864 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5e9efd20-f671-4b3e-9a60-1fc7c3fd3a1f tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:28.783280 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5e9efd20-f671-4b3e-9a60-1fc7c3fd3a1f tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:28.915688 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-5e9efd20-f671-4b3e-9a60-1fc7c3fd3a1f tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:28.923345 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-5e9efd20-f671-4b3e-9a60-1fc7c3fd3a1f tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d" status: 200 len: 1578 microversion: 2.1 time: 0.153000 Aug 26 00:59:28.923924 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 342/682] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:59:28 2022] GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d => generated 1578 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:59:29.477737 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-651af861-4f39-48b0-a053-a4fa899fd7eb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:29.478425 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-651af861-4f39-48b0-a053-a4fa899fd7eb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:29.485371 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-651af861-4f39-48b0-a053-a4fa899fd7eb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:29.485844 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-651af861-4f39-48b0-a053-a4fa899fd7eb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:29.486270 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-651af861-4f39-48b0-a053-a4fa899fd7eb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:29.487645 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-651af861-4f39-48b0-a053-a4fa899fd7eb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:29.488087 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-651af861-4f39-48b0-a053-a4fa899fd7eb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:29.488530 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-651af861-4f39-48b0-a053-a4fa899fd7eb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:29.550126 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-e6b36ad7-c383-4bc8-8b39-c73f006dc766 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:29.550669 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-e6b36ad7-c383-4bc8-8b39-c73f006dc766 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:29.556605 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e6b36ad7-c383-4bc8-8b39-c73f006dc766 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:29.557089 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e6b36ad7-c383-4bc8-8b39-c73f006dc766 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:29.557533 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e6b36ad7-c383-4bc8-8b39-c73f006dc766 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:29.558391 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e6b36ad7-c383-4bc8-8b39-c73f006dc766 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:29.558846 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e6b36ad7-c383-4bc8-8b39-c73f006dc766 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:29.559271 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e6b36ad7-c383-4bc8-8b39-c73f006dc766 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:29.620010 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-651af861-4f39-48b0-a053-a4fa899fd7eb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:29.628999 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-651af861-4f39-48b0-a053-a4fa899fd7eb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:29.630488 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-651af861-4f39-48b0-a053-a4fa899fd7eb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:29.631608 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-651af861-4f39-48b0-a053-a4fa899fd7eb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 200 len: 1723 microversion: 2.20 time: 0.158142 Aug 26 00:59:29.632184 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 341/683] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:59:29 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:59:29.686192 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-e6b36ad7-c383-4bc8-8b39-c73f006dc766 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:29.694626 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-e6b36ad7-c383-4bc8-8b39-c73f006dc766 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd" status: 200 len: 1691 microversion: 2.1 time: 0.148964 Aug 26 00:59:29.695191 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 343/684] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:59:29 2022] GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd => generated 1691 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:59:29.946764 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-44155887-99cb-428e-82d8-1d86ba770ee2 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:29.947304 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-44155887-99cb-428e-82d8-1d86ba770ee2 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: cc9ceee0-65b5-48be-8dcc-7ec2a992f72d] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:29.949282 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:59:29.954148 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-44155887-99cb-428e-82d8-1d86ba770ee2 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:29.954640 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-44155887-99cb-428e-82d8-1d86ba770ee2 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:29.955074 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-44155887-99cb-428e-82d8-1d86ba770ee2 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:29.955762 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-44155887-99cb-428e-82d8-1d86ba770ee2 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:29.956286 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-44155887-99cb-428e-82d8-1d86ba770ee2 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:29.956733 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-44155887-99cb-428e-82d8-1d86ba770ee2 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:30.084773 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-44155887-99cb-428e-82d8-1d86ba770ee2 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:30.092463 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-44155887-99cb-428e-82d8-1d86ba770ee2 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d" status: 200 len: 1578 microversion: 2.1 time: 0.149740 Aug 26 00:59:30.093049 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 342/685] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:59:29 2022] GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d => generated 1578 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:59:30.655238 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-63457ed0-9d2a-40b1-b758-a39ccd56198f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:30.655837 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-63457ed0-9d2a-40b1-b758-a39ccd56198f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:30.657866 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:59:30.662935 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-63457ed0-9d2a-40b1-b758-a39ccd56198f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:30.663668 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-63457ed0-9d2a-40b1-b758-a39ccd56198f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:30.664093 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-63457ed0-9d2a-40b1-b758-a39ccd56198f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:30.664791 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-63457ed0-9d2a-40b1-b758-a39ccd56198f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:30.665235 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-63457ed0-9d2a-40b1-b758-a39ccd56198f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:30.665648 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-63457ed0-9d2a-40b1-b758-a39ccd56198f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:30.716181 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-11e2f0c5-4c22-4cce-a72c-4e4b1e03c54f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:30.716815 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-11e2f0c5-4c22-4cce-a72c-4e4b1e03c54f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:30.725588 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-11e2f0c5-4c22-4cce-a72c-4e4b1e03c54f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:30.726069 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-11e2f0c5-4c22-4cce-a72c-4e4b1e03c54f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:30.726498 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-11e2f0c5-4c22-4cce-a72c-4e4b1e03c54f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:30.727215 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-11e2f0c5-4c22-4cce-a72c-4e4b1e03c54f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:30.728301 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-11e2f0c5-4c22-4cce-a72c-4e4b1e03c54f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:30.729415 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-11e2f0c5-4c22-4cce-a72c-4e4b1e03c54f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:30.803249 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-63457ed0-9d2a-40b1-b758-a39ccd56198f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:30.811369 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-63457ed0-9d2a-40b1-b758-a39ccd56198f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:30.812815 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-63457ed0-9d2a-40b1-b758-a39ccd56198f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:30.814173 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-63457ed0-9d2a-40b1-b758-a39ccd56198f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 200 len: 1723 microversion: 2.20 time: 0.163436 Aug 26 00:59:30.814592 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 344/686] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:59:30 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:59:30.868198 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-11e2f0c5-4c22-4cce-a72c-4e4b1e03c54f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:30.875890 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-11e2f0c5-4c22-4cce-a72c-4e4b1e03c54f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd" status: 200 len: 1691 microversion: 2.1 time: 0.164069 Aug 26 00:59:30.876443 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 343/687] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:59:30 2022] GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd => generated 1691 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:59:31.113169 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-24a094be-f418-4248-aacc-cec17a966aff tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:31.113808 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-24a094be-f418-4248-aacc-cec17a966aff tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: cc9ceee0-65b5-48be-8dcc-7ec2a992f72d] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:31.119676 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-24a094be-f418-4248-aacc-cec17a966aff tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:31.120154 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-24a094be-f418-4248-aacc-cec17a966aff tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:31.120610 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-24a094be-f418-4248-aacc-cec17a966aff tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:31.121295 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-24a094be-f418-4248-aacc-cec17a966aff tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:31.121737 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-24a094be-f418-4248-aacc-cec17a966aff tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:31.122155 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-24a094be-f418-4248-aacc-cec17a966aff tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:31.248059 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-24a094be-f418-4248-aacc-cec17a966aff tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:31.255695 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-24a094be-f418-4248-aacc-cec17a966aff tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d" status: 200 len: 1578 microversion: 2.1 time: 0.146393 Aug 26 00:59:31.256247 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 345/688] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:59:31 2022] GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d => generated 1578 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:59:31.836262 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-2db2ed82-294d-42b3-a483-c4bbf0b95935 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:31.836879 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-2db2ed82-294d-42b3-a483-c4bbf0b95935 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:31.843414 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2db2ed82-294d-42b3-a483-c4bbf0b95935 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:31.843889 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2db2ed82-294d-42b3-a483-c4bbf0b95935 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:31.844319 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2db2ed82-294d-42b3-a483-c4bbf0b95935 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:31.845029 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2db2ed82-294d-42b3-a483-c4bbf0b95935 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:31.845480 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2db2ed82-294d-42b3-a483-c4bbf0b95935 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:31.846553 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2db2ed82-294d-42b3-a483-c4bbf0b95935 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:31.897277 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-7a0115a5-2e24-4056-afe8-52c19223e4cc tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:31.897993 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-7a0115a5-2e24-4056-afe8-52c19223e4cc tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:31.904107 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-7a0115a5-2e24-4056-afe8-52c19223e4cc tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:31.904714 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-7a0115a5-2e24-4056-afe8-52c19223e4cc tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:31.905230 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-7a0115a5-2e24-4056-afe8-52c19223e4cc tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:31.906111 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-7a0115a5-2e24-4056-afe8-52c19223e4cc tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:31.906577 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-7a0115a5-2e24-4056-afe8-52c19223e4cc tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:31.907015 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-7a0115a5-2e24-4056-afe8-52c19223e4cc tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:31.979246 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-2db2ed82-294d-42b3-a483-c4bbf0b95935 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:31.988717 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-2db2ed82-294d-42b3-a483-c4bbf0b95935 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:31.990172 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-2db2ed82-294d-42b3-a483-c4bbf0b95935 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:31.991495 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-2db2ed82-294d-42b3-a483-c4bbf0b95935 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 200 len: 1723 microversion: 2.20 time: 0.159264 Aug 26 00:59:31.992397 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 344/689] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:59:31 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:59:32.040282 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-7a0115a5-2e24-4056-afe8-52c19223e4cc tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:32.048209 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-7a0115a5-2e24-4056-afe8-52c19223e4cc tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd" status: 200 len: 1691 microversion: 2.1 time: 0.155303 Aug 26 00:59:32.048811 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 346/690] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:59:31 2022] GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd => generated 1691 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:59:32.276877 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-fb4e2f41-097b-44eb-9440-1f81fd146c61 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:32.277412 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-fb4e2f41-097b-44eb-9440-1f81fd146c61 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: cc9ceee0-65b5-48be-8dcc-7ec2a992f72d] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:32.283361 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-fb4e2f41-097b-44eb-9440-1f81fd146c61 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:32.283842 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-fb4e2f41-097b-44eb-9440-1f81fd146c61 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:32.284275 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-fb4e2f41-097b-44eb-9440-1f81fd146c61 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:32.284998 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-fb4e2f41-097b-44eb-9440-1f81fd146c61 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:32.285449 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-fb4e2f41-097b-44eb-9440-1f81fd146c61 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:32.285870 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-fb4e2f41-097b-44eb-9440-1f81fd146c61 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:32.413040 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-fb4e2f41-097b-44eb-9440-1f81fd146c61 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:32.421264 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-fb4e2f41-097b-44eb-9440-1f81fd146c61 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d" status: 200 len: 1578 microversion: 2.1 time: 0.148302 Aug 26 00:59:32.421831 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 345/691] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:59:32 2022] GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d => generated 1578 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:59:33.015253 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-e7d4d0a4-20f1-409b-aedd-1e716b3b5f2b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:33.015253 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-e7d4d0a4-20f1-409b-aedd-1e716b3b5f2b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:33.021237 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e7d4d0a4-20f1-409b-aedd-1e716b3b5f2b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:33.021718 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e7d4d0a4-20f1-409b-aedd-1e716b3b5f2b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:33.022145 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e7d4d0a4-20f1-409b-aedd-1e716b3b5f2b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:33.022823 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e7d4d0a4-20f1-409b-aedd-1e716b3b5f2b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:33.023266 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e7d4d0a4-20f1-409b-aedd-1e716b3b5f2b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:33.023681 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e7d4d0a4-20f1-409b-aedd-1e716b3b5f2b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:33.069430 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-eadbafb7-9fa4-4e4f-9130-8f6d1fb50be3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:33.070072 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-eadbafb7-9fa4-4e4f-9130-8f6d1fb50be3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:33.076597 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-eadbafb7-9fa4-4e4f-9130-8f6d1fb50be3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:33.083787 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-eadbafb7-9fa4-4e4f-9130-8f6d1fb50be3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:33.083787 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-eadbafb7-9fa4-4e4f-9130-8f6d1fb50be3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:33.083787 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-eadbafb7-9fa4-4e4f-9130-8f6d1fb50be3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:33.083787 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-eadbafb7-9fa4-4e4f-9130-8f6d1fb50be3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:33.084690 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-eadbafb7-9fa4-4e4f-9130-8f6d1fb50be3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:33.163959 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-e7d4d0a4-20f1-409b-aedd-1e716b3b5f2b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:33.172747 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-e7d4d0a4-20f1-409b-aedd-1e716b3b5f2b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:33.174984 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-e7d4d0a4-20f1-409b-aedd-1e716b3b5f2b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:33.176178 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-e7d4d0a4-20f1-409b-aedd-1e716b3b5f2b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 200 len: 1723 microversion: 2.20 time: 0.165524 Aug 26 00:59:33.176781 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 347/692] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:59:33 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:59:33.442296 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-5c8b962d-0c2c-42c9-a8af-0cc8c95fc398 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:33.442883 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-5c8b962d-0c2c-42c9-a8af-0cc8c95fc398 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: cc9ceee0-65b5-48be-8dcc-7ec2a992f72d] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:33.448897 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5c8b962d-0c2c-42c9-a8af-0cc8c95fc398 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:33.449404 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5c8b962d-0c2c-42c9-a8af-0cc8c95fc398 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:33.449821 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5c8b962d-0c2c-42c9-a8af-0cc8c95fc398 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:33.450518 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5c8b962d-0c2c-42c9-a8af-0cc8c95fc398 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:33.450973 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5c8b962d-0c2c-42c9-a8af-0cc8c95fc398 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:33.451424 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5c8b962d-0c2c-42c9-a8af-0cc8c95fc398 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:33.454383 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-eadbafb7-9fa4-4e4f-9130-8f6d1fb50be3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:33.463268 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-eadbafb7-9fa4-4e4f-9130-8f6d1fb50be3 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd" status: 200 len: 1691 microversion: 2.1 time: 0.397938 Aug 26 00:59:33.463866 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 346/693] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:59:33 2022] GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd => generated 1691 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:59:33.591499 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-5c8b962d-0c2c-42c9-a8af-0cc8c95fc398 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:33.599257 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-5c8b962d-0c2c-42c9-a8af-0cc8c95fc398 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d" status: 200 len: 1578 microversion: 2.1 time: 0.161123 Aug 26 00:59:33.599822 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 348/694] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:59:33 2022] GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d => generated 1578 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:59:34.199244 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-5a690d88-6340-48c4-b96d-d979e0e945b7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:34.199853 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-5a690d88-6340-48c4-b96d-d979e0e945b7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:34.206374 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5a690d88-6340-48c4-b96d-d979e0e945b7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:34.206861 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5a690d88-6340-48c4-b96d-d979e0e945b7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:34.207293 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5a690d88-6340-48c4-b96d-d979e0e945b7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:34.208061 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5a690d88-6340-48c4-b96d-d979e0e945b7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:34.208718 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5a690d88-6340-48c4-b96d-d979e0e945b7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:34.209146 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5a690d88-6340-48c4-b96d-d979e0e945b7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:34.429816 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-5a690d88-6340-48c4-b96d-d979e0e945b7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:34.440863 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-5a690d88-6340-48c4-b96d-d979e0e945b7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:34.442434 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-5a690d88-6340-48c4-b96d-d979e0e945b7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:34.443695 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-5a690d88-6340-48c4-b96d-d979e0e945b7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 200 len: 1744 microversion: 2.20 time: 0.248459 Aug 26 00:59:34.444516 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 347/695] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:59:34 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 1744 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:59:34.484953 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-fc88191c-a036-4456-a7ad-d115f9ebc06e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:34.485514 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-fc88191c-a036-4456-a7ad-d115f9ebc06e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:34.492298 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fc88191c-a036-4456-a7ad-d115f9ebc06e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:34.492816 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fc88191c-a036-4456-a7ad-d115f9ebc06e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:34.493346 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fc88191c-a036-4456-a7ad-d115f9ebc06e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:34.494327 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fc88191c-a036-4456-a7ad-d115f9ebc06e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:34.494979 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fc88191c-a036-4456-a7ad-d115f9ebc06e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:34.495595 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fc88191c-a036-4456-a7ad-d115f9ebc06e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:34.619407 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-58169f80-322c-4913-a2e7-fd5dd219893f tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:34.620443 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-58169f80-322c-4913-a2e7-fd5dd219893f tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: cc9ceee0-65b5-48be-8dcc-7ec2a992f72d] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:34.626952 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-58169f80-322c-4913-a2e7-fd5dd219893f tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:34.627744 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-58169f80-322c-4913-a2e7-fd5dd219893f tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:34.628243 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-58169f80-322c-4913-a2e7-fd5dd219893f tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:34.629226 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-58169f80-322c-4913-a2e7-fd5dd219893f tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:34.629744 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-58169f80-322c-4913-a2e7-fd5dd219893f tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:34.630281 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-58169f80-322c-4913-a2e7-fd5dd219893f tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:34.689099 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-fc88191c-a036-4456-a7ad-d115f9ebc06e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:34.697265 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-fc88191c-a036-4456-a7ad-d115f9ebc06e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd" status: 200 len: 1691 microversion: 2.1 time: 0.216077 Aug 26 00:59:34.698071 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 349/696] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:59:34 2022] GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd => generated 1691 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:59:34.821795 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-58169f80-322c-4913-a2e7-fd5dd219893f tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:34.833821 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-58169f80-322c-4913-a2e7-fd5dd219893f tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d" status: 200 len: 1578 microversion: 2.1 time: 0.218295 Aug 26 00:59:34.836256 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 348/697] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:59:34 2022] GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d => generated 1578 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:59:35.097910 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [req-42591eb8-acf8-47b2-910d-ecce8c96dd80 req-6ebb8d5f-2238-47e8-8fdb-67dbc31826ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd", "name": "network-vif-deleted", "tag": "56f607c1-adc1-4120-ac0a-38b41904464e"}]} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:59:35.107220 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-42591eb8-acf8-47b2-910d-ecce8c96dd80 req-6ebb8d5f-2238-47e8-8fdb-67dbc31826ec service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:35.107696 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-42591eb8-acf8-47b2-910d-ecce8c96dd80 req-6ebb8d5f-2238-47e8-8fdb-67dbc31826ec service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:35.108121 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-42591eb8-acf8-47b2-910d-ecce8c96dd80 req-6ebb8d5f-2238-47e8-8fdb-67dbc31826ec service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:35.120178 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.compute.server_external_events [req-42591eb8-acf8-47b2-910d-ecce8c96dd80 req-6ebb8d5f-2238-47e8-8fdb-67dbc31826ec service nova] Creating event network-vif-deleted:56f607c1-adc1-4120-ac0a-38b41904464e for instance 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd on hv-cinder-83538 Aug 26 00:59:35.125071 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [req-42591eb8-acf8-47b2-910d-ecce8c96dd80 req-6ebb8d5f-2238-47e8-8fdb-67dbc31826ec service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031220 Aug 26 00:59:35.125625 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 350/698] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 00:59:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:59:35.135585 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [req-e019d848-6ef7-4973-986f-ae22c9da7768 req-ff1d54d0-3db8-41c7-b1bf-1a6de156529c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc9ceee0-65b5-48be-8dcc-7ec2a992f72d", "name": "network-vif-deleted", "tag": "6f818c22-5eed-4378-90e3-cf3becc67582"}]} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:59:35.145778 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-e019d848-6ef7-4973-986f-ae22c9da7768 req-ff1d54d0-3db8-41c7-b1bf-1a6de156529c service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:35.146498 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-e019d848-6ef7-4973-986f-ae22c9da7768 req-ff1d54d0-3db8-41c7-b1bf-1a6de156529c service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:35.147162 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-e019d848-6ef7-4973-986f-ae22c9da7768 req-ff1d54d0-3db8-41c7-b1bf-1a6de156529c service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:35.167657 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.compute.server_external_events [req-e019d848-6ef7-4973-986f-ae22c9da7768 req-ff1d54d0-3db8-41c7-b1bf-1a6de156529c service nova] Creating event network-vif-deleted:6f818c22-5eed-4378-90e3-cf3becc67582 for instance cc9ceee0-65b5-48be-8dcc-7ec2a992f72d on hv-cinder-83538 Aug 26 00:59:35.183073 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [req-e019d848-6ef7-4973-986f-ae22c9da7768 req-ff1d54d0-3db8-41c7-b1bf-1a6de156529c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044809 Aug 26 00:59:35.183073 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 349/699] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 00:59:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:59:35.471844 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-def5c270-de45-4c1c-bc04-4a46e4a381d1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:35.472983 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-def5c270-de45-4c1c-bc04-4a46e4a381d1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:35.486539 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-def5c270-de45-4c1c-bc04-4a46e4a381d1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:35.487119 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-def5c270-de45-4c1c-bc04-4a46e4a381d1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:35.487466 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-def5c270-de45-4c1c-bc04-4a46e4a381d1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:35.488212 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-def5c270-de45-4c1c-bc04-4a46e4a381d1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:35.489368 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-def5c270-de45-4c1c-bc04-4a46e4a381d1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:35.489834 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-def5c270-de45-4c1c-bc04-4a46e4a381d1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:35.644180 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-def5c270-de45-4c1c-bc04-4a46e4a381d1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:35.653466 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-def5c270-de45-4c1c-bc04-4a46e4a381d1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:35.654913 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-def5c270-de45-4c1c-bc04-4a46e4a381d1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:35.656389 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-def5c270-de45-4c1c-bc04-4a46e4a381d1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 200 len: 1744 microversion: 2.20 time: 0.192404 Aug 26 00:59:35.666485 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 351/700] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:59:35 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 1744 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:59:35.719917 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-c45466d5-f1bb-4625-85f6-04103d46c912 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:35.722635 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-c45466d5-f1bb-4625-85f6-04103d46c912 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:35.731265 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c45466d5-f1bb-4625-85f6-04103d46c912 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:35.732760 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c45466d5-f1bb-4625-85f6-04103d46c912 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:35.735132 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c45466d5-f1bb-4625-85f6-04103d46c912 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:35.736902 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c45466d5-f1bb-4625-85f6-04103d46c912 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:35.738047 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c45466d5-f1bb-4625-85f6-04103d46c912 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:35.738821 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c45466d5-f1bb-4625-85f6-04103d46c912 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:35.787631 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c45466d5-f1bb-4625-85f6-04103d46c912 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:35.788122 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c45466d5-f1bb-4625-85f6-04103d46c912 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:35.788929 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c45466d5-f1bb-4625-85f6-04103d46c912 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:35.789566 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.objects.instance [None req-c45466d5-f1bb-4625-85f6-04103d46c912 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lazy-loading 'fault' on Instance uuid 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd {{(pid=127565) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 00:59:35.855009 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-3737afe2-6fc5-4784-803d-ac87e6c6876f tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:35.856116 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-3737afe2-6fc5-4784-803d-ac87e6c6876f tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: cc9ceee0-65b5-48be-8dcc-7ec2a992f72d] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:35.865092 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-c45466d5-f1bb-4625-85f6-04103d46c912 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:35.880102 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3737afe2-6fc5-4784-803d-ac87e6c6876f tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:35.880839 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3737afe2-6fc5-4784-803d-ac87e6c6876f tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:35.881448 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3737afe2-6fc5-4784-803d-ac87e6c6876f tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:35.882205 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3737afe2-6fc5-4784-803d-ac87e6c6876f tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:35.882657 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3737afe2-6fc5-4784-803d-ac87e6c6876f tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:35.883120 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3737afe2-6fc5-4784-803d-ac87e6c6876f tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:35.885139 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-c45466d5-f1bb-4625-85f6-04103d46c912 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd" status: 200 len: 1336 microversion: 2.1 time: 0.161025 Aug 26 00:59:35.904603 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 350/701] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:59:35 2022] GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd => generated 1336 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:59:35.967796 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-3737afe2-6fc5-4784-803d-ac87e6c6876f tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:35.976076 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-3737afe2-6fc5-4784-803d-ac87e6c6876f tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d" status: 200 len: 1226 microversion: 2.1 time: 0.124748 Aug 26 00:59:35.978144 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 352/702] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:59:35 2022] GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d => generated 1226 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:59:36.680443 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-77c216a9-bc84-4985-bed6-3fd3fa34f50a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:36.681075 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-77c216a9-bc84-4985-bed6-3fd3fa34f50a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:36.687104 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-77c216a9-bc84-4985-bed6-3fd3fa34f50a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:36.687582 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-77c216a9-bc84-4985-bed6-3fd3fa34f50a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:36.688045 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-77c216a9-bc84-4985-bed6-3fd3fa34f50a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:36.688763 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-77c216a9-bc84-4985-bed6-3fd3fa34f50a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:36.689211 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-77c216a9-bc84-4985-bed6-3fd3fa34f50a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:36.689652 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-77c216a9-bc84-4985-bed6-3fd3fa34f50a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:36.693652 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:59:36.827017 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-77c216a9-bc84-4985-bed6-3fd3fa34f50a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:36.836731 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-77c216a9-bc84-4985-bed6-3fd3fa34f50a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:36.840252 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-77c216a9-bc84-4985-bed6-3fd3fa34f50a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:36.840252 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-77c216a9-bc84-4985-bed6-3fd3fa34f50a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 200 len: 1739 microversion: 2.20 time: 0.163544 Aug 26 00:59:36.840819 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 351/703] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:59:36 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 1739 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:59:36.911361 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-f8efcc7a-f6e6-454d-8194-c586c2259b2f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:36.914232 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-f8efcc7a-f6e6-454d-8194-c586c2259b2f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:36.918470 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f8efcc7a-f6e6-454d-8194-c586c2259b2f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:36.918986 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f8efcc7a-f6e6-454d-8194-c586c2259b2f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:36.919406 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f8efcc7a-f6e6-454d-8194-c586c2259b2f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:36.920102 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f8efcc7a-f6e6-454d-8194-c586c2259b2f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:36.920850 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f8efcc7a-f6e6-454d-8194-c586c2259b2f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:36.921738 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f8efcc7a-f6e6-454d-8194-c586c2259b2f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:36.954351 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f8efcc7a-f6e6-454d-8194-c586c2259b2f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:36.954836 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f8efcc7a-f6e6-454d-8194-c586c2259b2f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:36.955773 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f8efcc7a-f6e6-454d-8194-c586c2259b2f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:36.956233 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.objects.instance [None req-f8efcc7a-f6e6-454d-8194-c586c2259b2f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lazy-loading 'fault' on Instance uuid 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd {{(pid=127564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 00:59:36.997915 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-fcb54863-7acc-41d0-8f3a-7eb1ee062c70 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:36.999014 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-fcb54863-7acc-41d0-8f3a-7eb1ee062c70 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: cc9ceee0-65b5-48be-8dcc-7ec2a992f72d] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:37.006302 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-fcb54863-7acc-41d0-8f3a-7eb1ee062c70 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:37.013076 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-fcb54863-7acc-41d0-8f3a-7eb1ee062c70 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:37.013076 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-fcb54863-7acc-41d0-8f3a-7eb1ee062c70 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:37.013489 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-f8efcc7a-f6e6-454d-8194-c586c2259b2f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:37.013606 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-fcb54863-7acc-41d0-8f3a-7eb1ee062c70 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:37.013606 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-fcb54863-7acc-41d0-8f3a-7eb1ee062c70 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:37.013606 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-fcb54863-7acc-41d0-8f3a-7eb1ee062c70 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:37.016367 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-f8efcc7a-f6e6-454d-8194-c586c2259b2f tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd" status: 200 len: 1336 microversion: 2.1 time: 0.109280 Aug 26 00:59:37.030303 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 353/704] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:59:36 2022] GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd => generated 1336 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:59:37.043437 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-fcb54863-7acc-41d0-8f3a-7eb1ee062c70 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:37.043926 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-fcb54863-7acc-41d0-8f3a-7eb1ee062c70 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:37.044367 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-fcb54863-7acc-41d0-8f3a-7eb1ee062c70 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:37.045418 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.objects.instance [None req-fcb54863-7acc-41d0-8f3a-7eb1ee062c70 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lazy-loading 'fault' on Instance uuid cc9ceee0-65b5-48be-8dcc-7ec2a992f72d {{(pid=127565) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 00:59:37.090821 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-fcb54863-7acc-41d0-8f3a-7eb1ee062c70 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:37.099108 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-fcb54863-7acc-41d0-8f3a-7eb1ee062c70 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d" status: 200 len: 1231 microversion: 2.1 time: 0.105809 Aug 26 00:59:37.099680 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 352/705] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:59:36 2022] GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d => generated 1231 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:59:37.866050 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-022a4e9a-2654-4d24-bcf5-c1b9d30a1089 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:37.866847 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-022a4e9a-2654-4d24-bcf5-c1b9d30a1089 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:37.873329 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-022a4e9a-2654-4d24-bcf5-c1b9d30a1089 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:37.874071 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-022a4e9a-2654-4d24-bcf5-c1b9d30a1089 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:37.874820 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-022a4e9a-2654-4d24-bcf5-c1b9d30a1089 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:37.875675 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-022a4e9a-2654-4d24-bcf5-c1b9d30a1089 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:37.876281 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-022a4e9a-2654-4d24-bcf5-c1b9d30a1089 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:37.876911 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-022a4e9a-2654-4d24-bcf5-c1b9d30a1089 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:38.036864 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-022a4e9a-2654-4d24-bcf5-c1b9d30a1089 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:38.042685 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-19c421f2-b91f-4921-a778-0614ef9fdb1a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:38.043299 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-19c421f2-b91f-4921-a778-0614ef9fdb1a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:38.054712 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-19c421f2-b91f-4921-a778-0614ef9fdb1a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:38.055318 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-19c421f2-b91f-4921-a778-0614ef9fdb1a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:38.058262 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-19c421f2-b91f-4921-a778-0614ef9fdb1a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:38.058262 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-19c421f2-b91f-4921-a778-0614ef9fdb1a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:38.058262 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-19c421f2-b91f-4921-a778-0614ef9fdb1a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:38.058262 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-19c421f2-b91f-4921-a778-0614ef9fdb1a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:38.062791 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-022a4e9a-2654-4d24-bcf5-c1b9d30a1089 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:38.064347 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-022a4e9a-2654-4d24-bcf5-c1b9d30a1089 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:38.066077 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-022a4e9a-2654-4d24-bcf5-c1b9d30a1089 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 200 len: 1739 microversion: 2.20 time: 0.206213 Aug 26 00:59:38.066628 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 354/706] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:59:37 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 1739 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:59:38.080673 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.wsgi [None req-19c421f2-b91f-4921-a778-0614ef9fdb1a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] HTTP exception thrown: Instance 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd could not be found. Aug 26 00:59:38.082605 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-19c421f2-b91f-4921-a778-0614ef9fdb1a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Request method failure captured: Aug 26 00:59:38.082605 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: request: GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd HTTP/1.1 Aug 26 00:59:38.082605 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Accept: application/json Aug 26 00:59:38.082605 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Accept-Encoding: identity Aug 26 00:59:38.082605 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Connection: close Aug 26 00:59:38.082605 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Content-Length: 0 Aug 26 00:59:38.082605 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Content-Type: application/json Aug 26 00:59:38.082605 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Host: 10.222.0.59 Aug 26 00:59:38.082605 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Openstack-System-Scope: None Aug 26 00:59:38.082605 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: User-Agent: python-urllib3/1.26.11 Aug 26 00:59:38.082605 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Auth-Token: gAAAAABjCBmefHFNNUqFlMUE7I3i-93USVXZAM-jGRx67LwRrBQPHws8Ly74cPkf0mck5rrbALQjBE8Uy7qr03rwitlw4-vjXBtSJZuAAkljOdu1vNSZ4iHfo9uVWiTpSJogUteHYoVEbCAE9IBTiJYBlMj1AATIr86-7txLA_xIrQ0LluUT1u0 Aug 26 00:59:38.082605 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Domain-Id: None Aug 26 00:59:38.082605 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Domain-Name: None Aug 26 00:59:38.082605 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Identity-Status: Confirmed Aug 26 00:59:38.082605 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Is-Admin-Project: True Aug 26 00:59:38.082605 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Domain-Id: default Aug 26 00:59:38.082605 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Domain-Name: Default Aug 26 00:59:38.082605 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Id: 368f6a9e030e4aff9ef6559a6a165975 Aug 26 00:59:38.082605 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-988292211 Aug 26 00:59:38.082605 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Role: reader,member Aug 26 00:59:38.082605 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Roles: reader,member Aug 26 00:59:38.084154 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_368f6a9e030e4aff9ef6559a6a165975"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/368f6a9e030e4aff9ef6559a6a165975"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/368f6a9e030e4aff9ef6559a6a165975"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/368f6a9e030e4aff9ef6559a6a165975"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 00:59:38.084154 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant: tempest-ServerRescueNegativeTestJSON-988292211 Aug 26 00:59:38.084154 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant-Id: 368f6a9e030e4aff9ef6559a6a165975 Aug 26 00:59:38.084154 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-988292211 Aug 26 00:59:38.084154 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User: tempest-ServerRescueNegativeTestJSON-988292211-project Aug 26 00:59:38.084154 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Domain-Id: default Aug 26 00:59:38.084154 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Domain-Name: Default Aug 26 00:59:38.084154 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Id: 0cc36def73aa4bedb9e79d4cf11f5e8c Aug 26 00:59:38.084154 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Name: tempest-ServerRescueNegativeTestJSON-988292211-project Aug 26 00:59:38.084154 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: method: > Aug 26 00:59:38.084154 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: exception: Instance 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd could not be found. Aug 26 00:59:38.084154 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: action_args: {'id': '81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd'} Aug 26 00:59:38.085026 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 00:59:38.085026 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:59:38.085026 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 00:59:38.085026 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 00:59:38.085026 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 00:59:38.085026 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 00:59:38.085026 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 00:59:38.085026 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 00:59:38.085026 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 00:59:38.085026 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 00:59:38.085026 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd could not be found. Aug 26 00:59:38.085026 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:59:38.085026 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 00:59:38.085026 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:59:38.085026 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:59:38.085026 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 00:59:38.085026 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 00:59:38.085026 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 00:59:38.085026 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 00:59:38.085026 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 00:59:38.086371 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 00:59:38.086371 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 00:59:38.086371 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 00:59:38.086371 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 00:59:38.086371 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 00:59:38.086371 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 00:59:38.086371 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 00:59:38.086371 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd could not be found. Aug 26 00:59:38.086371 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:59:38.086371 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 00:59:38.086371 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:59:38.086371 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:59:38.086371 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 00:59:38.086371 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 00:59:38.086371 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 00:59:38.086371 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 00:59:38.086371 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd could not be found. Aug 26 00:59:38.086371 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:59:38.089314 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-19c421f2-b91f-4921-a778-0614ef9fdb1a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Returning 404 to user: Instance 81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd could not be found. {{(pid=127565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 00:59:38.090197 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-19c421f2-b91f-4921-a778-0614ef9fdb1a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd" status: 404 len: 111 microversion: 2.1 time: 0.055558 Aug 26 00:59:38.091016 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 353/707] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:59:38 2022] GET /compute/v2.1/servers/81a7aa96-9f4d-45f6-8c31-a0d6d3fb18fd => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 00:59:38.100361 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-5f6526e5-44dc-4ec7-acd0-a1280eaeb6ef tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '.version_select at 0x7f8a92f711f0>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:38.126395 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-b1f20140-ddd0-48ad-a374-fae1dd235adb tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:38.127670 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-b1f20140-ddd0-48ad-a374-fae1dd235adb tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: cc9ceee0-65b5-48be-8dcc-7ec2a992f72d] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:38.136257 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b1f20140-ddd0-48ad-a374-fae1dd235adb tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:38.136966 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b1f20140-ddd0-48ad-a374-fae1dd235adb tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:38.137380 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b1f20140-ddd0-48ad-a374-fae1dd235adb tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:38.138159 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b1f20140-ddd0-48ad-a374-fae1dd235adb tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:38.138795 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b1f20140-ddd0-48ad-a374-fae1dd235adb tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:38.139196 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b1f20140-ddd0-48ad-a374-fae1dd235adb tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:38.154975 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.wsgi [None req-b1f20140-ddd0-48ad-a374-fae1dd235adb tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] HTTP exception thrown: Instance cc9ceee0-65b5-48be-8dcc-7ec2a992f72d could not be found. Aug 26 00:59:38.157083 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-b1f20140-ddd0-48ad-a374-fae1dd235adb tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Request method failure captured: Aug 26 00:59:38.157083 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: request: GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d HTTP/1.1 Aug 26 00:59:38.157083 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Accept: application/json Aug 26 00:59:38.157083 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Accept-Encoding: identity Aug 26 00:59:38.157083 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Connection: close Aug 26 00:59:38.157083 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Content-Length: 0 Aug 26 00:59:38.157083 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Content-Type: application/json Aug 26 00:59:38.157083 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Host: 10.222.0.59 Aug 26 00:59:38.157083 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Openstack-System-Scope: None Aug 26 00:59:38.157083 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: User-Agent: python-urllib3/1.26.11 Aug 26 00:59:38.157083 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Auth-Token: gAAAAABjCBoQXDWgoIb8avBen_z7Yf4_X8lqQ4VhhdT4yopA3Omw06PWCCz09WXxNlA3d2mYMlvzrhuLGI89Oc1N5Vz9Y9ZKC004wdTzeie7QqFxXr85uqHzon1wox-7MHX6GOXDXm_hj_-g35MbQ1_gC1gpHFV94VF0fAsvAKXUCNgo4yFtyTo Aug 26 00:59:38.157083 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Domain-Id: None Aug 26 00:59:38.157083 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Domain-Name: None Aug 26 00:59:38.157083 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Identity-Status: Confirmed Aug 26 00:59:38.157083 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Is-Admin-Project: True Aug 26 00:59:38.157083 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Domain-Id: default Aug 26 00:59:38.157083 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Domain-Name: Default Aug 26 00:59:38.157083 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Id: ca3e24d51bdf44c5ad7219fa57d3d23b Aug 26 00:59:38.157083 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Name: tempest-TestVolumeBootPattern-2142040423 Aug 26 00:59:38.157083 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Role: reader,member Aug 26 00:59:38.157083 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Roles: reader,member Aug 26 00:59:38.158899 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ca3e24d51bdf44c5ad7219fa57d3d23b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ca3e24d51bdf44c5ad7219fa57d3d23b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ca3e24d51bdf44c5ad7219fa57d3d23b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ca3e24d51bdf44c5ad7219fa57d3d23b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 00:59:38.158899 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant: tempest-TestVolumeBootPattern-2142040423 Aug 26 00:59:38.158899 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant-Id: ca3e24d51bdf44c5ad7219fa57d3d23b Aug 26 00:59:38.158899 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant-Name: tempest-TestVolumeBootPattern-2142040423 Aug 26 00:59:38.158899 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User: tempest-TestVolumeBootPattern-2142040423-project Aug 26 00:59:38.158899 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Domain-Id: default Aug 26 00:59:38.158899 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Domain-Name: Default Aug 26 00:59:38.158899 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Id: cd45f1813efc4926a30454aaa108ac47 Aug 26 00:59:38.158899 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Name: tempest-TestVolumeBootPattern-2142040423-project Aug 26 00:59:38.158899 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: method: > Aug 26 00:59:38.158899 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: exception: Instance cc9ceee0-65b5-48be-8dcc-7ec2a992f72d could not be found. Aug 26 00:59:38.158899 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: action_args: {'id': 'cc9ceee0-65b5-48be-8dcc-7ec2a992f72d'} Aug 26 00:59:38.159764 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 00:59:38.159764 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:59:38.159764 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 00:59:38.159764 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 00:59:38.159764 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 00:59:38.159764 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 00:59:38.159764 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 00:59:38.159764 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 00:59:38.159764 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 00:59:38.159764 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 00:59:38.159764 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc9ceee0-65b5-48be-8dcc-7ec2a992f72d could not be found. Aug 26 00:59:38.159764 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:59:38.159764 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 00:59:38.159764 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:59:38.159764 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:59:38.159764 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 00:59:38.159764 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 00:59:38.159764 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 00:59:38.159764 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 00:59:38.159764 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 00:59:38.164013 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 00:59:38.164013 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 00:59:38.164013 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 00:59:38.164013 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 00:59:38.164013 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 00:59:38.164013 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 00:59:38.164013 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 00:59:38.164013 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc9ceee0-65b5-48be-8dcc-7ec2a992f72d could not be found. Aug 26 00:59:38.164013 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:59:38.164013 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 00:59:38.164013 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:59:38.164013 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:59:38.164013 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 00:59:38.164013 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 00:59:38.164013 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 00:59:38.164013 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 00:59:38.164013 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc9ceee0-65b5-48be-8dcc-7ec2a992f72d could not be found. Aug 26 00:59:38.164013 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:59:38.165448 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-b1f20140-ddd0-48ad-a374-fae1dd235adb tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Returning 404 to user: Instance cc9ceee0-65b5-48be-8dcc-7ec2a992f72d could not be found. {{(pid=127565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 00:59:38.165448 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-b1f20140-ddd0-48ad-a374-fae1dd235adb tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d" status: 404 len: 111 microversion: 2.1 time: 0.038119 Aug 26 00:59:38.165448 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 354/708] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:59:38 2022] GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 00:59:38.192584 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-5f6526e5-44dc-4ec7-acd0-a1280eaeb6ef tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1636012465" status: 202 len: 0 microversion: 2.1 time: 0.095610 Aug 26 00:59:38.198529 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 355/709] 10.222.0.59 () {58 vars in 1221 bytes} [Fri Aug 26 00:59:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1636012465 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 00:59:38.362372 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-4c35c305-dd29-49a8-95d7-4089bf9e62f1 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2117638627", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1867992654", "security_groups": [{"name": "tempest-secgroup-smoke-1310762645"}], "block_device_mapping_v2": [{"uuid": "8ee31a97-4f95-44ad-9fcc-c64ee2618ef3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "67cce745-2ab6-4c41-99b3-cb2978e1bfd5"}]}} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:59:38.550905 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.network.neutron [None req-4c35c305-dd29-49a8-95d7-4089bf9e62f1 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] validate_networks() for [('67cce745-2ab6-4c41-99b3-cb2978e1bfd5', None, None, None, None, None)] {{(pid=127565) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 00:59:38.562627 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [req-382faa86-d4d5-48e9-b6b7-a587206049a6 req-8410a9a4-d0c4-4ea4-8492-3f4edaabbddd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8af18a63-5c10-4530-9072-6ca92223b8ec", "name": "network-vif-plugged", "status": "completed", "tag": "abc8d4e4-fe47-4480-9cbb-c4ca4d73b355"}]} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:59:38.591651 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-382faa86-d4d5-48e9-b6b7-a587206049a6 req-8410a9a4-d0c4-4ea4-8492-3f4edaabbddd service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:38.594959 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-382faa86-d4d5-48e9-b6b7-a587206049a6 req-8410a9a4-d0c4-4ea4-8492-3f4edaabbddd service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:38.595596 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-382faa86-d4d5-48e9-b6b7-a587206049a6 req-8410a9a4-d0c4-4ea4-8492-3f4edaabbddd service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:38.620502 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.compute.server_external_events [req-382faa86-d4d5-48e9-b6b7-a587206049a6 req-8410a9a4-d0c4-4ea4-8492-3f4edaabbddd service nova] Creating event network-vif-plugged:abc8d4e4-fe47-4480-9cbb-c4ca4d73b355 for instance 8af18a63-5c10-4530-9072-6ca92223b8ec on hv-cinder-83538 Aug 26 00:59:38.638716 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [req-382faa86-d4d5-48e9-b6b7-a587206049a6 req-8410a9a4-d0c4-4ea4-8492-3f4edaabbddd service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159026 Aug 26 00:59:38.639986 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 356/710] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 00:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:59:39.049740 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.virt.hardware [None req-4c35c305-dd29-49a8-95d7-4089bf9e62f1 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Flavor limits 0:0:0 {{(pid=127565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 00:59:39.050961 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.virt.hardware [None req-4c35c305-dd29-49a8-95d7-4089bf9e62f1 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Image limits 0:0:0 {{(pid=127565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 00:59:39.051573 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.virt.hardware [None req-4c35c305-dd29-49a8-95d7-4089bf9e62f1 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Flavor pref 0:0:0 {{(pid=127565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 00:59:39.052022 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.virt.hardware [None req-4c35c305-dd29-49a8-95d7-4089bf9e62f1 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Image pref 0:0:0 {{(pid=127565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 00:59:39.052512 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.virt.hardware [None req-4c35c305-dd29-49a8-95d7-4089bf9e62f1 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 00:59:39.062647 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4c35c305-dd29-49a8-95d7-4089bf9e62f1 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:39.063790 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4c35c305-dd29-49a8-95d7-4089bf9e62f1 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:39.064531 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4c35c305-dd29-49a8-95d7-4089bf9e62f1 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:39.065643 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4c35c305-dd29-49a8-95d7-4089bf9e62f1 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:39.066332 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4c35c305-dd29-49a8-95d7-4089bf9e62f1 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:39.066964 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4c35c305-dd29-49a8-95d7-4089bf9e62f1 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:39.085889 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.quota [None req-4c35c305-dd29-49a8-95d7-4089bf9e62f1 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Getting quotas for project ca3e24d51bdf44c5ad7219fa57d3d23b. Resources: {'instances', 'ram', 'cores'} {{(pid=127565) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 00:59:39.090863 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.quota [None req-4c35c305-dd29-49a8-95d7-4089bf9e62f1 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Getting quotas for user cd45f1813efc4926a30454aaa108ac47 and project ca3e24d51bdf44c5ad7219fa57d3d23b. Resources: {'instances', 'ram', 'cores'} {{(pid=127565) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 00:59:39.098221 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-78b18e3f-9f07-4bd5-b7d2-abfaff421dc5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:39.099615 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-78b18e3f-9f07-4bd5-b7d2-abfaff421dc5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:39.106068 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-78b18e3f-9f07-4bd5-b7d2-abfaff421dc5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:39.106851 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-78b18e3f-9f07-4bd5-b7d2-abfaff421dc5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:39.107550 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-78b18e3f-9f07-4bd5-b7d2-abfaff421dc5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:39.108525 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-78b18e3f-9f07-4bd5-b7d2-abfaff421dc5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:39.109492 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-78b18e3f-9f07-4bd5-b7d2-abfaff421dc5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:39.110136 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-78b18e3f-9f07-4bd5-b7d2-abfaff421dc5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:39.154746 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-4c35c305-dd29-49a8-95d7-4089bf9e62f1 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Going to run 1 instances... {{(pid=127565) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 00:59:39.157321 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-4c35c305-dd29-49a8-95d7-4089bf9e62f1 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: 8638d924-308a-4f2b-945e-5798c738ee45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8ee31a97-4f95-44ad-9fcc-c64ee2618ef3',volume_size=None,volume_type=None)] {{(pid=127565) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 00:59:39.380422 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-78b18e3f-9f07-4bd5-b7d2-abfaff421dc5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:39.391311 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-78b18e3f-9f07-4bd5-b7d2-abfaff421dc5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:39.393945 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-78b18e3f-9f07-4bd5-b7d2-abfaff421dc5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:39.395625 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-78b18e3f-9f07-4bd5-b7d2-abfaff421dc5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 200 len: 1739 microversion: 2.20 time: 0.302775 Aug 26 00:59:39.396968 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 357/711] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:59:39 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 1739 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:59:39.550099 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-4c35c305-dd29-49a8-95d7-4089bf9e62f1 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.191548 Aug 26 00:59:39.557625 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 355/712] 10.222.0.59 () {60 vars in 1147 bytes} [Fri Aug 26 00:59:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 1200 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 00:59:39.562217 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-20912d07-54de-4066-811d-26ff57b04a6d tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:39.565015 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-20912d07-54de-4066-811d-26ff57b04a6d tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: 8638d924-308a-4f2b-945e-5798c738ee45] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:39.650584 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-20912d07-54de-4066-811d-26ff57b04a6d tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:39.658172 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-20912d07-54de-4066-811d-26ff57b04a6d tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/8638d924-308a-4f2b-945e-5798c738ee45" status: 200 len: 1095 microversion: 2.1 time: 0.099734 Aug 26 00:59:39.659961 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 358/713] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:59:39 2022] GET /compute/v2.1/servers/8638d924-308a-4f2b-945e-5798c738ee45 => generated 1095 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:59:40.420184 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-df82bdbe-ae3b-44d1-a835-785f1a18698f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:40.420834 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-df82bdbe-ae3b-44d1-a835-785f1a18698f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:40.429495 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-df82bdbe-ae3b-44d1-a835-785f1a18698f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:40.430011 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-df82bdbe-ae3b-44d1-a835-785f1a18698f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:40.430440 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-df82bdbe-ae3b-44d1-a835-785f1a18698f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:40.431133 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-df82bdbe-ae3b-44d1-a835-785f1a18698f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:40.431624 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-df82bdbe-ae3b-44d1-a835-785f1a18698f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:40.432032 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-df82bdbe-ae3b-44d1-a835-785f1a18698f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:40.574358 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-df82bdbe-ae3b-44d1-a835-785f1a18698f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:40.583251 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-df82bdbe-ae3b-44d1-a835-785f1a18698f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:40.585045 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-df82bdbe-ae3b-44d1-a835-785f1a18698f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:40.586215 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-df82bdbe-ae3b-44d1-a835-785f1a18698f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 200 len: 1739 microversion: 2.20 time: 0.170522 Aug 26 00:59:40.586822 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 356/714] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:59:40 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 1739 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 00:59:40.681033 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-313ca39f-7bc7-4281-81c3-068ec3426cf1 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:40.681697 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-313ca39f-7bc7-4281-81c3-068ec3426cf1 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: 8638d924-308a-4f2b-945e-5798c738ee45] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:40.739553 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-313ca39f-7bc7-4281-81c3-068ec3426cf1 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:40.743080 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-313ca39f-7bc7-4281-81c3-068ec3426cf1 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/8638d924-308a-4f2b-945e-5798c738ee45" status: 200 len: 1095 microversion: 2.1 time: 0.066114 Aug 26 00:59:40.743625 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 359/715] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:59:40 2022] GET /compute/v2.1/servers/8638d924-308a-4f2b-945e-5798c738ee45 => generated 1095 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:59:41.610163 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-10af287f-8848-4196-8f96-dc6e526f1b8e tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:41.612056 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-10af287f-8848-4196-8f96-dc6e526f1b8e tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:41.619731 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-10af287f-8848-4196-8f96-dc6e526f1b8e tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:41.620515 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-10af287f-8848-4196-8f96-dc6e526f1b8e tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:41.621408 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-10af287f-8848-4196-8f96-dc6e526f1b8e tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:41.622109 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-10af287f-8848-4196-8f96-dc6e526f1b8e tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:41.622863 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-10af287f-8848-4196-8f96-dc6e526f1b8e tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:41.623446 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-10af287f-8848-4196-8f96-dc6e526f1b8e tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:41.767930 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-d22d3cf4-fd02-4a6f-82d3-2ecbf4721a83 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:41.769413 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-d22d3cf4-fd02-4a6f-82d3-2ecbf4721a83 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: 8638d924-308a-4f2b-945e-5798c738ee45] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:41.779209 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-d22d3cf4-fd02-4a6f-82d3-2ecbf4721a83 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:41.780217 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-d22d3cf4-fd02-4a6f-82d3-2ecbf4721a83 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:41.782786 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-d22d3cf4-fd02-4a6f-82d3-2ecbf4721a83 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:41.783732 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-d22d3cf4-fd02-4a6f-82d3-2ecbf4721a83 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:41.787141 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-d22d3cf4-fd02-4a6f-82d3-2ecbf4721a83 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:41.787771 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-d22d3cf4-fd02-4a6f-82d3-2ecbf4721a83 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:41.797628 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:59:41.838263 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-10af287f-8848-4196-8f96-dc6e526f1b8e tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:41.852679 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-10af287f-8848-4196-8f96-dc6e526f1b8e tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:41.854933 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-10af287f-8848-4196-8f96-dc6e526f1b8e tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:41.857920 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-10af287f-8848-4196-8f96-dc6e526f1b8e tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 200 len: 1739 microversion: 2.20 time: 0.250641 Aug 26 00:59:41.869347 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 357/716] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:59:41 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 1739 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 00:59:41.887226 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-d22d3cf4-fd02-4a6f-82d3-2ecbf4721a83 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:41.895629 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-d22d3cf4-fd02-4a6f-82d3-2ecbf4721a83 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/8638d924-308a-4f2b-945e-5798c738ee45" status: 200 len: 1193 microversion: 2.1 time: 0.136335 Aug 26 00:59:41.896133 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 360/717] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:59:41 2022] GET /compute/v2.1/servers/8638d924-308a-4f2b-945e-5798c738ee45 => generated 1193 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:59:42.098887 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-c593151d-0159-49c7-837d-cbe8324c0380 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:42.099371 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-c593151d-0159-49c7-837d-cbe8324c0380 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:42.105615 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c593151d-0159-49c7-837d-cbe8324c0380 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:42.106338 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c593151d-0159-49c7-837d-cbe8324c0380 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:42.106794 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c593151d-0159-49c7-837d-cbe8324c0380 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:42.107467 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c593151d-0159-49c7-837d-cbe8324c0380 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:42.107915 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c593151d-0159-49c7-837d-cbe8324c0380 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:42.108330 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c593151d-0159-49c7-837d-cbe8324c0380 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:42.135755 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-c593151d-0159-49c7-837d-cbe8324c0380 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Going to try to terminate instance {{(pid=127565) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 00:59:42.421717 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-c593151d-0159-49c7-837d-cbe8324c0380 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "DELETE /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 204 len: 0 microversion: 2.1 time: 0.327125 Aug 26 00:59:42.426275 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 358/718] 10.222.0.59 () {58 vars in 1239 bytes} [Fri Aug 26 00:59:42 2022] DELETE /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 00:59:42.439577 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-9681d1f1-9b7e-4c3d-8b8f-457968a1f2c0 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:42.439577 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-9681d1f1-9b7e-4c3d-8b8f-457968a1f2c0 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:42.445602 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9681d1f1-9b7e-4c3d-8b8f-457968a1f2c0 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:42.447373 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9681d1f1-9b7e-4c3d-8b8f-457968a1f2c0 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:42.455594 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9681d1f1-9b7e-4c3d-8b8f-457968a1f2c0 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:42.457400 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9681d1f1-9b7e-4c3d-8b8f-457968a1f2c0 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:42.458107 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9681d1f1-9b7e-4c3d-8b8f-457968a1f2c0 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:42.460040 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9681d1f1-9b7e-4c3d-8b8f-457968a1f2c0 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:42.646339 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-9681d1f1-9b7e-4c3d-8b8f-457968a1f2c0 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:42.655415 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-9681d1f1-9b7e-4c3d-8b8f-457968a1f2c0 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1509 microversion: 2.1 time: 0.227342 Aug 26 00:59:42.656236 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 361/719] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:59:42 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1509 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:59:42.887061 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-1dc4b2f4-3cb2-444e-a320-9fd5b56b82a5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:42.888023 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-1dc4b2f4-3cb2-444e-a320-9fd5b56b82a5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:42.897912 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1dc4b2f4-3cb2-444e-a320-9fd5b56b82a5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:42.898747 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1dc4b2f4-3cb2-444e-a320-9fd5b56b82a5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:42.899630 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1dc4b2f4-3cb2-444e-a320-9fd5b56b82a5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:42.900634 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1dc4b2f4-3cb2-444e-a320-9fd5b56b82a5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:42.901208 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1dc4b2f4-3cb2-444e-a320-9fd5b56b82a5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:42.901759 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1dc4b2f4-3cb2-444e-a320-9fd5b56b82a5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:42.917457 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-eee07945-9bae-4443-b378-9b4b075b5ea6 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:42.918815 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-eee07945-9bae-4443-b378-9b4b075b5ea6 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: 8638d924-308a-4f2b-945e-5798c738ee45] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:42.926484 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-eee07945-9bae-4443-b378-9b4b075b5ea6 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:42.927359 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-eee07945-9bae-4443-b378-9b4b075b5ea6 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:42.928026 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-eee07945-9bae-4443-b378-9b4b075b5ea6 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:42.929509 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-eee07945-9bae-4443-b378-9b4b075b5ea6 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:42.930471 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-eee07945-9bae-4443-b378-9b4b075b5ea6 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:42.930901 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-eee07945-9bae-4443-b378-9b4b075b5ea6 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:43.010215 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-eee07945-9bae-4443-b378-9b4b075b5ea6 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:43.020331 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-eee07945-9bae-4443-b378-9b4b075b5ea6 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/8638d924-308a-4f2b-945e-5798c738ee45" status: 200 len: 1211 microversion: 2.1 time: 0.107319 Aug 26 00:59:43.021523 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 362/720] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:59:42 2022] GET /compute/v2.1/servers/8638d924-308a-4f2b-945e-5798c738ee45 => generated 1211 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:59:43.087574 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-1dc4b2f4-3cb2-444e-a320-9fd5b56b82a5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:43.099462 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-1dc4b2f4-3cb2-444e-a320-9fd5b56b82a5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:43.101595 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-1dc4b2f4-3cb2-444e-a320-9fd5b56b82a5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:43.102781 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-1dc4b2f4-3cb2-444e-a320-9fd5b56b82a5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 200 len: 1739 microversion: 2.20 time: 0.220376 Aug 26 00:59:43.103536 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 359/721] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:59:42 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 1739 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:59:43.678572 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-f6005cb0-eb75-428d-b54d-1895d688334a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:43.679419 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-f6005cb0-eb75-428d-b54d-1895d688334a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:43.685865 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f6005cb0-eb75-428d-b54d-1895d688334a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:43.686434 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f6005cb0-eb75-428d-b54d-1895d688334a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:43.686942 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f6005cb0-eb75-428d-b54d-1895d688334a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:43.687715 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f6005cb0-eb75-428d-b54d-1895d688334a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:43.688246 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f6005cb0-eb75-428d-b54d-1895d688334a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:43.688790 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f6005cb0-eb75-428d-b54d-1895d688334a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:43.824924 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-f6005cb0-eb75-428d-b54d-1895d688334a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:43.833988 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-f6005cb0-eb75-428d-b54d-1895d688334a tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1509 microversion: 2.1 time: 0.159185 Aug 26 00:59:43.834580 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 363/722] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:59:43 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:59:44.046996 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-9100720f-b1db-4905-b077-1352657a3d26 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:44.047625 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-9100720f-b1db-4905-b077-1352657a3d26 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: 8638d924-308a-4f2b-945e-5798c738ee45] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:44.054711 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9100720f-b1db-4905-b077-1352657a3d26 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:44.055181 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9100720f-b1db-4905-b077-1352657a3d26 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:44.055608 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9100720f-b1db-4905-b077-1352657a3d26 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:44.056277 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9100720f-b1db-4905-b077-1352657a3d26 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:44.056742 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9100720f-b1db-4905-b077-1352657a3d26 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:44.057154 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9100720f-b1db-4905-b077-1352657a3d26 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:44.123699 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-9100720f-b1db-4905-b077-1352657a3d26 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:44.130490 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-01614336-6e33-4fa1-9495-aaab31a6dae1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:44.131104 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-01614336-6e33-4fa1-9495-aaab31a6dae1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:44.131948 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-9100720f-b1db-4905-b077-1352657a3d26 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/8638d924-308a-4f2b-945e-5798c738ee45" status: 200 len: 1211 microversion: 2.1 time: 0.088923 Aug 26 00:59:44.132698 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 360/723] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:59:44 2022] GET /compute/v2.1/servers/8638d924-308a-4f2b-945e-5798c738ee45 => generated 1211 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:59:44.137534 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-01614336-6e33-4fa1-9495-aaab31a6dae1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:44.138391 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-01614336-6e33-4fa1-9495-aaab31a6dae1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:44.138903 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-01614336-6e33-4fa1-9495-aaab31a6dae1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:44.139719 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-01614336-6e33-4fa1-9495-aaab31a6dae1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:44.140403 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-01614336-6e33-4fa1-9495-aaab31a6dae1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:44.140937 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-01614336-6e33-4fa1-9495-aaab31a6dae1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:44.313608 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-01614336-6e33-4fa1-9495-aaab31a6dae1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:44.323152 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-01614336-6e33-4fa1-9495-aaab31a6dae1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:44.324850 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-01614336-6e33-4fa1-9495-aaab31a6dae1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:44.326205 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-01614336-6e33-4fa1-9495-aaab31a6dae1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 200 len: 1739 microversion: 2.20 time: 0.199518 Aug 26 00:59:44.328524 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 364/724] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:59:44 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 1739 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 00:59:44.860725 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-50679b97-0ce4-4c0c-b08d-6eaf49e7a42b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:44.862000 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-50679b97-0ce4-4c0c-b08d-6eaf49e7a42b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:44.880304 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-50679b97-0ce4-4c0c-b08d-6eaf49e7a42b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:44.880304 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-50679b97-0ce4-4c0c-b08d-6eaf49e7a42b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:44.880304 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-50679b97-0ce4-4c0c-b08d-6eaf49e7a42b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:44.880304 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-50679b97-0ce4-4c0c-b08d-6eaf49e7a42b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:44.880792 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-50679b97-0ce4-4c0c-b08d-6eaf49e7a42b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:44.880792 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-50679b97-0ce4-4c0c-b08d-6eaf49e7a42b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:45.065795 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [req-a3a4b923-a3ef-48fa-be62-d970a838e685 req-8dac8fa2-bef3-4396-9ed5-bee55fa6503f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be", "name": "network-vif-deleted", "tag": "833db4f2-eca1-40db-a1e7-c07312b7e9d1"}]} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:59:45.083753 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-a3a4b923-a3ef-48fa-be62-d970a838e685 req-8dac8fa2-bef3-4396-9ed5-bee55fa6503f service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:45.084379 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-a3a4b923-a3ef-48fa-be62-d970a838e685 req-8dac8fa2-bef3-4396-9ed5-bee55fa6503f service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:45.089257 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-a3a4b923-a3ef-48fa-be62-d970a838e685 req-8dac8fa2-bef3-4396-9ed5-bee55fa6503f service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:45.102891 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-50679b97-0ce4-4c0c-b08d-6eaf49e7a42b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:45.111879 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-50679b97-0ce4-4c0c-b08d-6eaf49e7a42b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1467 microversion: 2.1 time: 0.257136 Aug 26 00:59:45.118416 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 361/725] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:59:44 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1467 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:59:45.151213 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.compute.server_external_events [req-a3a4b923-a3ef-48fa-be62-d970a838e685 req-8dac8fa2-bef3-4396-9ed5-bee55fa6503f service nova] Creating event network-vif-deleted:833db4f2-eca1-40db-a1e7-c07312b7e9d1 for instance 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be on hv-cinder-83538 Aug 26 00:59:45.153365 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-b2666fd2-10aa-4e96-99cd-108672df0783 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:45.153979 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-b2666fd2-10aa-4e96-99cd-108672df0783 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: 8638d924-308a-4f2b-945e-5798c738ee45] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:45.160058 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [req-a3a4b923-a3ef-48fa-be62-d970a838e685 req-8dac8fa2-bef3-4396-9ed5-bee55fa6503f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100048 Aug 26 00:59:45.160764 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 365/726] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 00:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 00:59:45.161134 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b2666fd2-10aa-4e96-99cd-108672df0783 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:45.169015 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b2666fd2-10aa-4e96-99cd-108672df0783 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:45.170436 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b2666fd2-10aa-4e96-99cd-108672df0783 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:45.175064 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b2666fd2-10aa-4e96-99cd-108672df0783 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:45.177753 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b2666fd2-10aa-4e96-99cd-108672df0783 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:45.179080 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b2666fd2-10aa-4e96-99cd-108672df0783 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:45.365865 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-393f545c-255e-4cb7-b926-e877d880c0c0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:45.366676 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-393f545c-255e-4cb7-b926-e877d880c0c0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:45.396686 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-393f545c-255e-4cb7-b926-e877d880c0c0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:45.398160 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-393f545c-255e-4cb7-b926-e877d880c0c0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:45.401918 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-393f545c-255e-4cb7-b926-e877d880c0c0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:45.405604 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-393f545c-255e-4cb7-b926-e877d880c0c0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:45.409816 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-b2666fd2-10aa-4e96-99cd-108672df0783 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:45.413522 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-393f545c-255e-4cb7-b926-e877d880c0c0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:45.414328 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-393f545c-255e-4cb7-b926-e877d880c0c0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:45.424381 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-b2666fd2-10aa-4e96-99cd-108672df0783 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/8638d924-308a-4f2b-945e-5798c738ee45" status: 200 len: 1279 microversion: 2.1 time: 0.275485 Aug 26 00:59:45.429994 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 362/727] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:59:45 2022] GET /compute/v2.1/servers/8638d924-308a-4f2b-945e-5798c738ee45 => generated 1279 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:59:45.687451 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-393f545c-255e-4cb7-b926-e877d880c0c0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:45.697038 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-393f545c-255e-4cb7-b926-e877d880c0c0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:45.698771 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-393f545c-255e-4cb7-b926-e877d880c0c0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:45.700132 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-393f545c-255e-4cb7-b926-e877d880c0c0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 200 len: 1739 microversion: 2.20 time: 0.352736 Aug 26 00:59:45.715953 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 366/728] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:59:45 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 1739 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 00:59:46.135914 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-ee03cca4-11a6-43e0-a3ab-e72c98e84624 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:46.136908 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-ee03cca4-11a6-43e0-a3ab-e72c98e84624 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:46.146764 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ee03cca4-11a6-43e0-a3ab-e72c98e84624 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:46.147604 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ee03cca4-11a6-43e0-a3ab-e72c98e84624 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:46.148106 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ee03cca4-11a6-43e0-a3ab-e72c98e84624 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:46.148938 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ee03cca4-11a6-43e0-a3ab-e72c98e84624 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:46.149692 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ee03cca4-11a6-43e0-a3ab-e72c98e84624 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:46.150321 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ee03cca4-11a6-43e0-a3ab-e72c98e84624 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:46.190279 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ee03cca4-11a6-43e0-a3ab-e72c98e84624 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:46.191088 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ee03cca4-11a6-43e0-a3ab-e72c98e84624 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:46.191485 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ee03cca4-11a6-43e0-a3ab-e72c98e84624 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:46.191922 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.objects.instance [None req-ee03cca4-11a6-43e0-a3ab-e72c98e84624 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lazy-loading 'fault' on Instance uuid 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be {{(pid=127565) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 00:59:46.240155 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-ee03cca4-11a6-43e0-a3ab-e72c98e84624 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:46.248915 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-ee03cca4-11a6-43e0-a3ab-e72c98e84624 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 200 len: 1312 microversion: 2.1 time: 0.117440 Aug 26 00:59:46.249873 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [req-18e0a31c-1147-4517-ab44-f9362fbd5e85 req-17886c25-4d17-4e35-941f-3fa6c5ac9576 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8638d924-308a-4f2b-945e-5798c738ee45", "tag": "ea9f0339-afc5-4a08-9e7f-4f43f30fd859"}]} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:59:46.251826 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 363/729] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:59:46 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 1312 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:59:46.266559 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-18e0a31c-1147-4517-ab44-f9362fbd5e85 req-17886c25-4d17-4e35-941f-3fa6c5ac9576 service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:46.267046 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-18e0a31c-1147-4517-ab44-f9362fbd5e85 req-17886c25-4d17-4e35-941f-3fa6c5ac9576 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:46.267527 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-18e0a31c-1147-4517-ab44-f9362fbd5e85 req-17886c25-4d17-4e35-941f-3fa6c5ac9576 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:46.287702 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.compute.server_external_events [req-18e0a31c-1147-4517-ab44-f9362fbd5e85 req-17886c25-4d17-4e35-941f-3fa6c5ac9576 service nova] Creating event network-changed:ea9f0339-afc5-4a08-9e7f-4f43f30fd859 for instance 8638d924-308a-4f2b-945e-5798c738ee45 on hv-cinder-83538 Aug 26 00:59:46.294926 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [req-18e0a31c-1147-4517-ab44-f9362fbd5e85 req-17886c25-4d17-4e35-941f-3fa6c5ac9576 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048980 Aug 26 00:59:46.296098 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 367/730] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 00:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 00:59:46.452124 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-390234cb-2c85-493a-ae66-e64e6baa1581 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:46.452124 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-390234cb-2c85-493a-ae66-e64e6baa1581 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: 8638d924-308a-4f2b-945e-5798c738ee45] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:46.457242 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-390234cb-2c85-493a-ae66-e64e6baa1581 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:46.457960 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-390234cb-2c85-493a-ae66-e64e6baa1581 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:46.458580 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-390234cb-2c85-493a-ae66-e64e6baa1581 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:46.459464 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-390234cb-2c85-493a-ae66-e64e6baa1581 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:46.460084 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-390234cb-2c85-493a-ae66-e64e6baa1581 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:46.460863 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-390234cb-2c85-493a-ae66-e64e6baa1581 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:46.668769 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-390234cb-2c85-493a-ae66-e64e6baa1581 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:46.684099 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-390234cb-2c85-493a-ae66-e64e6baa1581 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/8638d924-308a-4f2b-945e-5798c738ee45" status: 200 len: 1267 microversion: 2.1 time: 0.236182 Aug 26 00:59:46.699953 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 364/731] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:59:46 2022] GET /compute/v2.1/servers/8638d924-308a-4f2b-945e-5798c738ee45 => generated 1267 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:59:46.727464 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-62c13b38-431a-4701-8b79-cffcb421d399 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:46.728824 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-62c13b38-431a-4701-8b79-cffcb421d399 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:46.736880 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-62c13b38-431a-4701-8b79-cffcb421d399 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:46.737647 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-62c13b38-431a-4701-8b79-cffcb421d399 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:46.738081 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-62c13b38-431a-4701-8b79-cffcb421d399 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:46.739150 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-62c13b38-431a-4701-8b79-cffcb421d399 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:46.740509 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-62c13b38-431a-4701-8b79-cffcb421d399 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:46.741138 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-62c13b38-431a-4701-8b79-cffcb421d399 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:47.008573 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-62c13b38-431a-4701-8b79-cffcb421d399 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:47.019271 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-62c13b38-431a-4701-8b79-cffcb421d399 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:47.021195 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-62c13b38-431a-4701-8b79-cffcb421d399 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:47.022720 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-62c13b38-431a-4701-8b79-cffcb421d399 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 200 len: 1739 microversion: 2.20 time: 0.302184 Aug 26 00:59:47.038596 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 368/732] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:59:46 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 1739 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:59:47.274868 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-5fe31a19-7b69-41cc-a1c1-a723f60ce9d9 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:47.276125 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-5fe31a19-7b69-41cc-a1c1-a723f60ce9d9 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:47.283456 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5fe31a19-7b69-41cc-a1c1-a723f60ce9d9 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:47.284245 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5fe31a19-7b69-41cc-a1c1-a723f60ce9d9 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:47.285430 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5fe31a19-7b69-41cc-a1c1-a723f60ce9d9 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:47.286314 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5fe31a19-7b69-41cc-a1c1-a723f60ce9d9 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:47.286913 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5fe31a19-7b69-41cc-a1c1-a723f60ce9d9 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:47.287485 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5fe31a19-7b69-41cc-a1c1-a723f60ce9d9 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:47.304742 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.wsgi [None req-5fe31a19-7b69-41cc-a1c1-a723f60ce9d9 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] HTTP exception thrown: Instance 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be could not be found. Aug 26 00:59:47.306842 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-5fe31a19-7b69-41cc-a1c1-a723f60ce9d9 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Request method failure captured: Aug 26 00:59:47.306842 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: request: GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be HTTP/1.1 Aug 26 00:59:47.306842 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Accept: application/json Aug 26 00:59:47.306842 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Accept-Encoding: identity Aug 26 00:59:47.306842 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Connection: close Aug 26 00:59:47.306842 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Content-Length: 0 Aug 26 00:59:47.306842 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Content-Type: application/json Aug 26 00:59:47.306842 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Host: 10.222.0.59 Aug 26 00:59:47.306842 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Openstack-System-Scope: None Aug 26 00:59:47.306842 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: User-Agent: python-urllib3/1.26.11 Aug 26 00:59:47.306842 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Auth-Token: gAAAAABjCBmefHFNNUqFlMUE7I3i-93USVXZAM-jGRx67LwRrBQPHws8Ly74cPkf0mck5rrbALQjBE8Uy7qr03rwitlw4-vjXBtSJZuAAkljOdu1vNSZ4iHfo9uVWiTpSJogUteHYoVEbCAE9IBTiJYBlMj1AATIr86-7txLA_xIrQ0LluUT1u0 Aug 26 00:59:47.306842 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Domain-Id: None Aug 26 00:59:47.306842 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Domain-Name: None Aug 26 00:59:47.306842 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Identity-Status: Confirmed Aug 26 00:59:47.306842 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Is-Admin-Project: True Aug 26 00:59:47.306842 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Domain-Id: default Aug 26 00:59:47.306842 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Domain-Name: Default Aug 26 00:59:47.306842 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Id: 368f6a9e030e4aff9ef6559a6a165975 Aug 26 00:59:47.306842 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-988292211 Aug 26 00:59:47.306842 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Role: reader,member Aug 26 00:59:47.306842 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Roles: reader,member Aug 26 00:59:47.308699 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_368f6a9e030e4aff9ef6559a6a165975"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/368f6a9e030e4aff9ef6559a6a165975"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/368f6a9e030e4aff9ef6559a6a165975"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/368f6a9e030e4aff9ef6559a6a165975"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 00:59:47.308699 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant: tempest-ServerRescueNegativeTestJSON-988292211 Aug 26 00:59:47.308699 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant-Id: 368f6a9e030e4aff9ef6559a6a165975 Aug 26 00:59:47.308699 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-988292211 Aug 26 00:59:47.308699 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User: tempest-ServerRescueNegativeTestJSON-988292211-project Aug 26 00:59:47.308699 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Domain-Id: default Aug 26 00:59:47.308699 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Domain-Name: Default Aug 26 00:59:47.308699 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Id: 0cc36def73aa4bedb9e79d4cf11f5e8c Aug 26 00:59:47.308699 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Name: tempest-ServerRescueNegativeTestJSON-988292211-project Aug 26 00:59:47.308699 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: method: > Aug 26 00:59:47.308699 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: exception: Instance 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be could not be found. Aug 26 00:59:47.308699 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: action_args: {'id': '4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be'} Aug 26 00:59:47.309664 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 00:59:47.309664 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:59:47.309664 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 00:59:47.309664 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 00:59:47.309664 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 00:59:47.309664 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 00:59:47.309664 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 00:59:47.309664 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 00:59:47.309664 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 00:59:47.309664 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 00:59:47.309664 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be could not be found. Aug 26 00:59:47.309664 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:59:47.309664 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 00:59:47.309664 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:59:47.309664 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:59:47.309664 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 00:59:47.309664 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 00:59:47.309664 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 00:59:47.309664 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 00:59:47.309664 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 00:59:47.311174 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 00:59:47.311174 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 00:59:47.311174 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 00:59:47.311174 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 00:59:47.311174 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 00:59:47.311174 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 00:59:47.311174 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 00:59:47.311174 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be could not be found. Aug 26 00:59:47.311174 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:59:47.311174 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 00:59:47.311174 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:59:47.311174 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:59:47.311174 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 00:59:47.311174 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 00:59:47.311174 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 00:59:47.311174 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 00:59:47.311174 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be could not be found. Aug 26 00:59:47.311174 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:59:47.313234 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-5fe31a19-7b69-41cc-a1c1-a723f60ce9d9 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Returning 404 to user: Instance 4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be could not be found. {{(pid=127565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 00:59:47.320267 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-5fe31a19-7b69-41cc-a1c1-a723f60ce9d9 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be" status: 404 len: 111 microversion: 2.1 time: 0.043656 Aug 26 00:59:47.320267 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 365/733] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:59:47 2022] GET /compute/v2.1/servers/4372cbf9-334a-4d8e-9d8e-edb3b7cbd8be => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 00:59:47.324870 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-50e5e59c-ecf5-480d-b84f-bfea303efbd9 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:47.325412 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-50e5e59c-ecf5-480d-b84f-bfea303efbd9 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:47.331577 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-50e5e59c-ecf5-480d-b84f-bfea303efbd9 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:47.332277 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-50e5e59c-ecf5-480d-b84f-bfea303efbd9 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:47.332907 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-50e5e59c-ecf5-480d-b84f-bfea303efbd9 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:47.333862 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-50e5e59c-ecf5-480d-b84f-bfea303efbd9 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:47.334746 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-50e5e59c-ecf5-480d-b84f-bfea303efbd9 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:47.335169 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-50e5e59c-ecf5-480d-b84f-bfea303efbd9 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:47.364707 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-50e5e59c-ecf5-480d-b84f-bfea303efbd9 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab] Going to try to terminate instance {{(pid=127564) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 00:59:47.627664 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-50e5e59c-ecf5-480d-b84f-bfea303efbd9 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "DELETE /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab" status: 204 len: 0 microversion: 2.1 time: 0.306916 Aug 26 00:59:47.628249 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 369/734] 10.222.0.59 () {58 vars in 1239 bytes} [Fri Aug 26 00:59:47 2022] DELETE /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 26 00:59:47.636791 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-4f912577-1daf-4a41-a7f7-d4b600a53b7e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:47.637432 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-4f912577-1daf-4a41-a7f7-d4b600a53b7e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:47.644432 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4f912577-1daf-4a41-a7f7-d4b600a53b7e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:47.644961 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4f912577-1daf-4a41-a7f7-d4b600a53b7e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:47.645427 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4f912577-1daf-4a41-a7f7-d4b600a53b7e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:47.646229 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4f912577-1daf-4a41-a7f7-d4b600a53b7e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:47.646702 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4f912577-1daf-4a41-a7f7-d4b600a53b7e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:47.647141 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4f912577-1daf-4a41-a7f7-d4b600a53b7e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:47.707623 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-dbfbf9ec-d1d1-4793-a9c0-6eea7dabf3cd tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:47.708981 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-dbfbf9ec-d1d1-4793-a9c0-6eea7dabf3cd tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: 8638d924-308a-4f2b-945e-5798c738ee45] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:47.716565 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-dbfbf9ec-d1d1-4793-a9c0-6eea7dabf3cd tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:47.728758 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-dbfbf9ec-d1d1-4793-a9c0-6eea7dabf3cd tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:47.728758 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-dbfbf9ec-d1d1-4793-a9c0-6eea7dabf3cd tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:47.728758 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-dbfbf9ec-d1d1-4793-a9c0-6eea7dabf3cd tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:47.728758 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-dbfbf9ec-d1d1-4793-a9c0-6eea7dabf3cd tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:47.729312 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-dbfbf9ec-d1d1-4793-a9c0-6eea7dabf3cd tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:47.791382 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-4f912577-1daf-4a41-a7f7-d4b600a53b7e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:47.799623 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-4f912577-1daf-4a41-a7f7-d4b600a53b7e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab" status: 200 len: 1522 microversion: 2.1 time: 0.167015 Aug 26 00:59:47.800233 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 366/735] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:59:47 2022] GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:59:48.050317 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-3e810e6f-88c2-4a5e-88d7-0726465ef618 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:48.050933 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-3e810e6f-88c2-4a5e-88d7-0726465ef618 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:48.057436 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3e810e6f-88c2-4a5e-88d7-0726465ef618 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:48.057921 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3e810e6f-88c2-4a5e-88d7-0726465ef618 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:48.058352 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3e810e6f-88c2-4a5e-88d7-0726465ef618 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:48.059093 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3e810e6f-88c2-4a5e-88d7-0726465ef618 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:48.059572 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3e810e6f-88c2-4a5e-88d7-0726465ef618 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:48.060017 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3e810e6f-88c2-4a5e-88d7-0726465ef618 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:48.129464 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-dbfbf9ec-d1d1-4793-a9c0-6eea7dabf3cd tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:48.137524 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-dbfbf9ec-d1d1-4793-a9c0-6eea7dabf3cd tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/8638d924-308a-4f2b-945e-5798c738ee45" status: 200 len: 1267 microversion: 2.1 time: 0.434769 Aug 26 00:59:48.138096 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 370/736] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:59:47 2022] GET /compute/v2.1/servers/8638d924-308a-4f2b-945e-5798c738ee45 => generated 1267 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:59:48.195583 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-3e810e6f-88c2-4a5e-88d7-0726465ef618 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:48.203884 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-3e810e6f-88c2-4a5e-88d7-0726465ef618 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:48.205926 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-3e810e6f-88c2-4a5e-88d7-0726465ef618 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:48.207121 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-3e810e6f-88c2-4a5e-88d7-0726465ef618 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 200 len: 1739 microversion: 2.20 time: 0.162044 Aug 26 00:59:48.207671 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 367/737] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:59:48 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 1739 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 00:59:48.820543 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-ee69618b-de0d-43e0-a845-f1c7a41ef263 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:48.821795 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-ee69618b-de0d-43e0-a845-f1c7a41ef263 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:48.828194 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ee69618b-de0d-43e0-a845-f1c7a41ef263 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:48.828779 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ee69618b-de0d-43e0-a845-f1c7a41ef263 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:48.829427 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ee69618b-de0d-43e0-a845-f1c7a41ef263 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:48.830378 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ee69618b-de0d-43e0-a845-f1c7a41ef263 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:48.830830 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ee69618b-de0d-43e0-a845-f1c7a41ef263 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:48.831256 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ee69618b-de0d-43e0-a845-f1c7a41ef263 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:48.981351 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-ee69618b-de0d-43e0-a845-f1c7a41ef263 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:48.989693 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-ee69618b-de0d-43e0-a845-f1c7a41ef263 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab" status: 200 len: 1522 microversion: 2.1 time: 0.172898 Aug 26 00:59:48.990271 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 371/738] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:59:48 2022] GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:59:49.158547 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-eb02da4e-d060-4c3a-bf52-9aa499613bd4 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:49.159116 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-eb02da4e-d060-4c3a-bf52-9aa499613bd4 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: 8638d924-308a-4f2b-945e-5798c738ee45] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:49.161564 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell0:SELECT=2 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:59:49.162232 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell0:SELECT=6 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:59:49.167459 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-eb02da4e-d060-4c3a-bf52-9aa499613bd4 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:49.172359 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-eb02da4e-d060-4c3a-bf52-9aa499613bd4 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:49.172359 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-eb02da4e-d060-4c3a-bf52-9aa499613bd4 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:49.172359 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-eb02da4e-d060-4c3a-bf52-9aa499613bd4 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:49.172359 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-eb02da4e-d060-4c3a-bf52-9aa499613bd4 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:49.172765 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-eb02da4e-d060-4c3a-bf52-9aa499613bd4 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:49.174029 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:59:49.229544 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-12becc70-f61b-4f8e-9ea1-5cb35005aade tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:49.230017 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-12becc70-f61b-4f8e-9ea1-5cb35005aade tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:49.237339 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-12becc70-f61b-4f8e-9ea1-5cb35005aade tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:49.238096 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-12becc70-f61b-4f8e-9ea1-5cb35005aade tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:49.238096 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-12becc70-f61b-4f8e-9ea1-5cb35005aade tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:49.238754 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-12becc70-f61b-4f8e-9ea1-5cb35005aade tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:49.239209 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-12becc70-f61b-4f8e-9ea1-5cb35005aade tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:49.239635 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-12becc70-f61b-4f8e-9ea1-5cb35005aade tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:49.308055 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-eb02da4e-d060-4c3a-bf52-9aa499613bd4 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:49.317831 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-eb02da4e-d060-4c3a-bf52-9aa499613bd4 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/8638d924-308a-4f2b-945e-5798c738ee45" status: 200 len: 1267 microversion: 2.1 time: 0.163517 Aug 26 00:59:49.328506 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 368/739] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:59:49 2022] GET /compute/v2.1/servers/8638d924-308a-4f2b-945e-5798c738ee45 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:59:49.375748 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-12becc70-f61b-4f8e-9ea1-5cb35005aade tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:49.384504 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-12becc70-f61b-4f8e-9ea1-5cb35005aade tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:49.385981 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-12becc70-f61b-4f8e-9ea1-5cb35005aade tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:49.387135 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-12becc70-f61b-4f8e-9ea1-5cb35005aade tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 200 len: 1739 microversion: 2.20 time: 0.161745 Aug 26 00:59:49.387678 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 372/740] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:59:49 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 1739 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:59:50.010556 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-53c49490-ecda-4c60-9fed-e7a17b87a91d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:50.011166 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-53c49490-ecda-4c60-9fed-e7a17b87a91d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:50.017992 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-53c49490-ecda-4c60-9fed-e7a17b87a91d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:50.018471 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-53c49490-ecda-4c60-9fed-e7a17b87a91d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:50.018910 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-53c49490-ecda-4c60-9fed-e7a17b87a91d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:50.019600 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-53c49490-ecda-4c60-9fed-e7a17b87a91d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:50.020174 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-53c49490-ecda-4c60-9fed-e7a17b87a91d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:50.020620 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-53c49490-ecda-4c60-9fed-e7a17b87a91d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:50.148594 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-53c49490-ecda-4c60-9fed-e7a17b87a91d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:50.156643 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-53c49490-ecda-4c60-9fed-e7a17b87a91d tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab" status: 200 len: 1522 microversion: 2.1 time: 0.150195 Aug 26 00:59:50.157214 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 369/741] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:59:50 2022] GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:59:50.339078 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-4a44233f-fb98-4a63-9777-e27bfb3ed036 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:50.339692 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-4a44233f-fb98-4a63-9777-e27bfb3ed036 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: 8638d924-308a-4f2b-945e-5798c738ee45] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:50.345690 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-4a44233f-fb98-4a63-9777-e27bfb3ed036 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:50.346167 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-4a44233f-fb98-4a63-9777-e27bfb3ed036 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:50.346603 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-4a44233f-fb98-4a63-9777-e27bfb3ed036 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:50.347289 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-4a44233f-fb98-4a63-9777-e27bfb3ed036 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:50.347739 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-4a44233f-fb98-4a63-9777-e27bfb3ed036 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:50.348185 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-4a44233f-fb98-4a63-9777-e27bfb3ed036 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:50.410240 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-0d1568c1-eae7-45da-a820-239907592050 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:50.410853 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-0d1568c1-eae7-45da-a820-239907592050 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:50.417540 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0d1568c1-eae7-45da-a820-239907592050 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:50.418028 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0d1568c1-eae7-45da-a820-239907592050 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:50.418466 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0d1568c1-eae7-45da-a820-239907592050 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:50.419161 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0d1568c1-eae7-45da-a820-239907592050 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:50.419617 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0d1568c1-eae7-45da-a820-239907592050 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:50.420246 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0d1568c1-eae7-45da-a820-239907592050 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:50.480429 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-4a44233f-fb98-4a63-9777-e27bfb3ed036 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:50.486947 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-4a44233f-fb98-4a63-9777-e27bfb3ed036 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/8638d924-308a-4f2b-945e-5798c738ee45" status: 200 len: 1267 microversion: 2.1 time: 0.151653 Aug 26 00:59:50.487511 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 373/742] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:59:50 2022] GET /compute/v2.1/servers/8638d924-308a-4f2b-945e-5798c738ee45 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:59:50.560369 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-0d1568c1-eae7-45da-a820-239907592050 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:50.569153 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-0d1568c1-eae7-45da-a820-239907592050 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:50.570596 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-0d1568c1-eae7-45da-a820-239907592050 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:50.571951 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-0d1568c1-eae7-45da-a820-239907592050 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 200 len: 1739 microversion: 2.20 time: 0.165590 Aug 26 00:59:50.572532 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 370/743] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:59:50 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 1739 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 00:59:51.179792 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-db9242d9-c25c-4d12-99ac-57a52b8c956c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:51.180693 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-db9242d9-c25c-4d12-99ac-57a52b8c956c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:51.183863 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell0:SELECT=4 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:59:51.187374 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-db9242d9-c25c-4d12-99ac-57a52b8c956c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:51.188069 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-db9242d9-c25c-4d12-99ac-57a52b8c956c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:51.188522 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-db9242d9-c25c-4d12-99ac-57a52b8c956c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:51.189730 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-db9242d9-c25c-4d12-99ac-57a52b8c956c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:51.190332 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-db9242d9-c25c-4d12-99ac-57a52b8c956c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:51.190913 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-db9242d9-c25c-4d12-99ac-57a52b8c956c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:51.282700 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-db9242d9-c25c-4d12-99ac-57a52b8c956c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:51.291541 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-db9242d9-c25c-4d12-99ac-57a52b8c956c tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab" status: 200 len: 1480 microversion: 2.1 time: 0.115829 Aug 26 00:59:51.292241 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 374/744] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:59:51 2022] GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab => generated 1480 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:59:51.294740 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [req-e6fd9e59-6756-492f-8ae7-84143f9d3002 req-72b5f7ae-3383-416e-bcb6-eb25b761d942 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3079fdb4-9b6d-4030-a7ce-bdf5bff324ab", "name": "network-vif-deleted", "tag": "370c2a59-a26b-4a3e-8768-1300357aad68"}]} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:59:51.304888 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-e6fd9e59-6756-492f-8ae7-84143f9d3002 req-72b5f7ae-3383-416e-bcb6-eb25b761d942 service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:51.305360 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-e6fd9e59-6756-492f-8ae7-84143f9d3002 req-72b5f7ae-3383-416e-bcb6-eb25b761d942 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:51.305793 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-e6fd9e59-6756-492f-8ae7-84143f9d3002 req-72b5f7ae-3383-416e-bcb6-eb25b761d942 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:51.317709 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.compute.server_external_events [req-e6fd9e59-6756-492f-8ae7-84143f9d3002 req-72b5f7ae-3383-416e-bcb6-eb25b761d942 service nova] Creating event network-vif-deleted:370c2a59-a26b-4a3e-8768-1300357aad68 for instance 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab on hv-cinder-83538 Aug 26 00:59:51.322512 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [req-e6fd9e59-6756-492f-8ae7-84143f9d3002 req-72b5f7ae-3383-416e-bcb6-eb25b761d942 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031476 Aug 26 00:59:51.324515 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 371/745] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 00:59:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:59:51.507760 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-b6de6845-eaa6-46fd-b960-298ca6a4aa03 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:51.508523 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-b6de6845-eaa6-46fd-b960-298ca6a4aa03 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: 8638d924-308a-4f2b-945e-5798c738ee45] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:51.514721 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b6de6845-eaa6-46fd-b960-298ca6a4aa03 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:51.515203 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b6de6845-eaa6-46fd-b960-298ca6a4aa03 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:51.515640 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b6de6845-eaa6-46fd-b960-298ca6a4aa03 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:51.516328 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b6de6845-eaa6-46fd-b960-298ca6a4aa03 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:51.516857 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b6de6845-eaa6-46fd-b960-298ca6a4aa03 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:51.517293 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b6de6845-eaa6-46fd-b960-298ca6a4aa03 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:51.596397 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-aa03b6b6-b9c6-4085-9827-ce72f39b4c8f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:51.597238 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-aa03b6b6-b9c6-4085-9827-ce72f39b4c8f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:51.603847 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-aa03b6b6-b9c6-4085-9827-ce72f39b4c8f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:51.604421 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-aa03b6b6-b9c6-4085-9827-ce72f39b4c8f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:51.604974 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-aa03b6b6-b9c6-4085-9827-ce72f39b4c8f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:51.605765 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-aa03b6b6-b9c6-4085-9827-ce72f39b4c8f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:51.606291 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-aa03b6b6-b9c6-4085-9827-ce72f39b4c8f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:51.606819 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-aa03b6b6-b9c6-4085-9827-ce72f39b4c8f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:51.671484 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-b6de6845-eaa6-46fd-b960-298ca6a4aa03 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:51.684279 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-b6de6845-eaa6-46fd-b960-298ca6a4aa03 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/8638d924-308a-4f2b-945e-5798c738ee45" status: 200 len: 1267 microversion: 2.1 time: 0.180332 Aug 26 00:59:51.684918 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 375/746] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:59:51 2022] GET /compute/v2.1/servers/8638d924-308a-4f2b-945e-5798c738ee45 => generated 1267 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:59:51.750174 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-aa03b6b6-b9c6-4085-9827-ce72f39b4c8f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:51.758499 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-aa03b6b6-b9c6-4085-9827-ce72f39b4c8f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:51.759977 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-aa03b6b6-b9c6-4085-9827-ce72f39b4c8f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:51.761174 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-aa03b6b6-b9c6-4085-9827-ce72f39b4c8f tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 200 len: 1721 microversion: 2.20 time: 0.170466 Aug 26 00:59:51.761730 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 372/747] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:59:51 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 00:59:52.313484 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-623d4152-28a1-487f-84d7-dae3122ab67e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:52.314595 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-623d4152-28a1-487f-84d7-dae3122ab67e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:52.320519 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-623d4152-28a1-487f-84d7-dae3122ab67e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:52.321006 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-623d4152-28a1-487f-84d7-dae3122ab67e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:52.321443 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-623d4152-28a1-487f-84d7-dae3122ab67e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:52.322124 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-623d4152-28a1-487f-84d7-dae3122ab67e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:52.322574 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-623d4152-28a1-487f-84d7-dae3122ab67e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:52.323118 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-623d4152-28a1-487f-84d7-dae3122ab67e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:52.341432 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:59:52.388955 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-623d4152-28a1-487f-84d7-dae3122ab67e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:52.397173 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-623d4152-28a1-487f-84d7-dae3122ab67e tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab" status: 200 len: 1480 microversion: 2.1 time: 0.087644 Aug 26 00:59:52.397737 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 376/748] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:59:52 2022] GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab => generated 1480 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:59:52.704044 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-aec70207-fec8-433a-8e48-221850801b4f tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:52.705294 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-aec70207-fec8-433a-8e48-221850801b4f tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: 8638d924-308a-4f2b-945e-5798c738ee45] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:52.711753 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-aec70207-fec8-433a-8e48-221850801b4f tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:52.712235 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-aec70207-fec8-433a-8e48-221850801b4f tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:52.712721 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-aec70207-fec8-433a-8e48-221850801b4f tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:52.713411 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-aec70207-fec8-433a-8e48-221850801b4f tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:52.713863 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-aec70207-fec8-433a-8e48-221850801b4f tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:52.714283 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-aec70207-fec8-433a-8e48-221850801b4f tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:52.784271 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-6e36817b-ff5c-4ddd-a962-37f88873f490 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:52.784907 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-6e36817b-ff5c-4ddd-a962-37f88873f490 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:52.791781 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6e36817b-ff5c-4ddd-a962-37f88873f490 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:52.792267 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6e36817b-ff5c-4ddd-a962-37f88873f490 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:52.792805 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6e36817b-ff5c-4ddd-a962-37f88873f490 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:52.793501 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6e36817b-ff5c-4ddd-a962-37f88873f490 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:52.793950 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6e36817b-ff5c-4ddd-a962-37f88873f490 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:52.794376 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6e36817b-ff5c-4ddd-a962-37f88873f490 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:52.843914 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-aec70207-fec8-433a-8e48-221850801b4f tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:52.851949 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-aec70207-fec8-433a-8e48-221850801b4f tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/8638d924-308a-4f2b-945e-5798c738ee45" status: 200 len: 1267 microversion: 2.1 time: 0.151817 Aug 26 00:59:52.852531 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 373/749] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:59:52 2022] GET /compute/v2.1/servers/8638d924-308a-4f2b-945e-5798c738ee45 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:59:52.927194 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-6e36817b-ff5c-4ddd-a962-37f88873f490 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:52.934369 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-6e36817b-ff5c-4ddd-a962-37f88873f490 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:52.935804 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-6e36817b-ff5c-4ddd-a962-37f88873f490 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:52.937023 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-6e36817b-ff5c-4ddd-a962-37f88873f490 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 200 len: 1721 microversion: 2.20 time: 0.156661 Aug 26 00:59:52.937580 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 377/750] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:59:52 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 00:59:53.418582 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-2509d70c-6c91-40c6-9f2a-28df82680b2b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:53.419106 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-2509d70c-6c91-40c6-9f2a-28df82680b2b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:53.425895 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2509d70c-6c91-40c6-9f2a-28df82680b2b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:53.426374 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2509d70c-6c91-40c6-9f2a-28df82680b2b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:53.426803 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2509d70c-6c91-40c6-9f2a-28df82680b2b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:53.427482 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2509d70c-6c91-40c6-9f2a-28df82680b2b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:53.427925 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2509d70c-6c91-40c6-9f2a-28df82680b2b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:53.428343 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2509d70c-6c91-40c6-9f2a-28df82680b2b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:53.489383 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-2509d70c-6c91-40c6-9f2a-28df82680b2b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:53.497205 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-2509d70c-6c91-40c6-9f2a-28df82680b2b tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab" status: 200 len: 1307 microversion: 2.1 time: 0.082586 Aug 26 00:59:53.497769 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 374/751] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:59:53 2022] GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab => generated 1307 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:59:53.873866 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-12419f72-285f-4b7c-9930-cd75f61269d3 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:53.874577 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-12419f72-285f-4b7c-9930-cd75f61269d3 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: 8638d924-308a-4f2b-945e-5798c738ee45] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:53.881198 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-12419f72-285f-4b7c-9930-cd75f61269d3 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:53.881782 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-12419f72-285f-4b7c-9930-cd75f61269d3 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:53.882507 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-12419f72-285f-4b7c-9930-cd75f61269d3 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:53.883232 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-12419f72-285f-4b7c-9930-cd75f61269d3 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:53.883690 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-12419f72-285f-4b7c-9930-cd75f61269d3 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:53.884117 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-12419f72-285f-4b7c-9930-cd75f61269d3 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:53.959958 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-1ec49c26-73b1-4168-b094-63a54ded923a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:53.960750 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-1ec49c26-73b1-4168-b094-63a54ded923a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:53.968232 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1ec49c26-73b1-4168-b094-63a54ded923a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:53.968909 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1ec49c26-73b1-4168-b094-63a54ded923a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:53.969487 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1ec49c26-73b1-4168-b094-63a54ded923a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:53.970293 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1ec49c26-73b1-4168-b094-63a54ded923a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:53.970981 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1ec49c26-73b1-4168-b094-63a54ded923a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:53.971624 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1ec49c26-73b1-4168-b094-63a54ded923a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:54.117089 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-12419f72-285f-4b7c-9930-cd75f61269d3 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:54.122656 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-1ec49c26-73b1-4168-b094-63a54ded923a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:54.127060 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-12419f72-285f-4b7c-9930-cd75f61269d3 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/8638d924-308a-4f2b-945e-5798c738ee45" status: 200 len: 1267 microversion: 2.1 time: 0.256865 Aug 26 00:59:54.127811 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 378/752] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:59:53 2022] GET /compute/v2.1/servers/8638d924-308a-4f2b-945e-5798c738ee45 => generated 1267 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:59:54.137388 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-1ec49c26-73b1-4168-b094-63a54ded923a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:54.138910 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-1ec49c26-73b1-4168-b094-63a54ded923a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:54.143110 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-1ec49c26-73b1-4168-b094-63a54ded923a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 200 len: 1724 microversion: 2.20 time: 0.184210 Aug 26 00:59:54.143110 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 375/753] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:59:53 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 00:59:54.163023 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-6596769d-06a0-4d03-9ec0-8ad3197b731b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "76fa929d-be46-4579-89d3-e11855e0d44d"}} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:59:54.165701 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-6596769d-06a0-4d03-9ec0-8ad3197b731b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:54.171606 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6596769d-06a0-4d03-9ec0-8ad3197b731b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:54.172087 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6596769d-06a0-4d03-9ec0-8ad3197b731b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:54.172548 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6596769d-06a0-4d03-9ec0-8ad3197b731b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:54.173279 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6596769d-06a0-4d03-9ec0-8ad3197b731b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:54.173721 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6596769d-06a0-4d03-9ec0-8ad3197b731b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:54.174139 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6596769d-06a0-4d03-9ec0-8ad3197b731b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:54.383644 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [req-1974369f-c97d-4047-b7f5-1de0d799da0f req-42ac455f-efd4-4c6a-ada9-eb2aeb9cd356 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8af18a63-5c10-4530-9072-6ca92223b8ec", "name": "network-vif-unplugged", "status": "completed", "tag": "abc8d4e4-fe47-4480-9cbb-c4ca4d73b355"}]} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:59:54.394412 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-1974369f-c97d-4047-b7f5-1de0d799da0f req-42ac455f-efd4-4c6a-ada9-eb2aeb9cd356 service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:54.394925 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-1974369f-c97d-4047-b7f5-1de0d799da0f req-42ac455f-efd4-4c6a-ada9-eb2aeb9cd356 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:54.395357 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-1974369f-c97d-4047-b7f5-1de0d799da0f req-42ac455f-efd4-4c6a-ada9-eb2aeb9cd356 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:54.408580 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.compute.server_external_events [req-1974369f-c97d-4047-b7f5-1de0d799da0f req-42ac455f-efd4-4c6a-ada9-eb2aeb9cd356 service nova] Creating event network-vif-unplugged:abc8d4e4-fe47-4480-9cbb-c4ca4d73b355 for instance 8af18a63-5c10-4530-9072-6ca92223b8ec on hv-cinder-83538 Aug 26 00:59:54.414061 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [req-1974369f-c97d-4047-b7f5-1de0d799da0f req-42ac455f-efd4-4c6a-ada9-eb2aeb9cd356 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033986 Aug 26 00:59:54.418294 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 376/754] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 00:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:59:54.518365 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-8329fa7a-3e66-4321-9d0b-82181e3df556 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:54.519100 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-8329fa7a-3e66-4321-9d0b-82181e3df556 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:54.525930 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8329fa7a-3e66-4321-9d0b-82181e3df556 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:54.526404 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8329fa7a-3e66-4321-9d0b-82181e3df556 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:54.526829 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8329fa7a-3e66-4321-9d0b-82181e3df556 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:54.527503 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8329fa7a-3e66-4321-9d0b-82181e3df556 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:54.527963 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8329fa7a-3e66-4321-9d0b-82181e3df556 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:54.528361 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8329fa7a-3e66-4321-9d0b-82181e3df556 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:54.556571 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:59:54.559883 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8329fa7a-3e66-4321-9d0b-82181e3df556 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:54.560351 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8329fa7a-3e66-4321-9d0b-82181e3df556 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:54.560809 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8329fa7a-3e66-4321-9d0b-82181e3df556 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:54.561242 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.objects.instance [None req-8329fa7a-3e66-4321-9d0b-82181e3df556 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lazy-loading 'fault' on Instance uuid 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab {{(pid=127565) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 00:59:54.602949 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-8329fa7a-3e66-4321-9d0b-82181e3df556 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc36def73aa4bedb9e79d4cf11f5e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368f6a9e030e4aff9ef6559a6a165975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:54.611282 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-8329fa7a-3e66-4321-9d0b-82181e3df556 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab" status: 200 len: 1312 microversion: 2.1 time: 0.097076 Aug 26 00:59:54.611849 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 377/755] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:59:54 2022] GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab => generated 1312 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 00:59:55.147610 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-0643bcd6-25e4-4dbc-9d0c-ced06507c593 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:55.148226 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-0643bcd6-25e4-4dbc-9d0c-ced06507c593 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: 8638d924-308a-4f2b-945e-5798c738ee45] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:55.154760 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0643bcd6-25e4-4dbc-9d0c-ced06507c593 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:55.155241 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0643bcd6-25e4-4dbc-9d0c-ced06507c593 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:55.155675 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0643bcd6-25e4-4dbc-9d0c-ced06507c593 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:55.156361 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0643bcd6-25e4-4dbc-9d0c-ced06507c593 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:55.156842 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0643bcd6-25e4-4dbc-9d0c-ced06507c593 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:55.157264 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0643bcd6-25e4-4dbc-9d0c-ced06507c593 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:55.209930 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-6596769d-06a0-4d03-9ec0-8ad3197b731b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "POST /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.050702 Aug 26 00:59:55.210780 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 379/756] 10.222.0.59 () {62 vars in 1364 bytes} [Fri Aug 26 00:59:54 2022] POST /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec/os-volume_attachments => generated 188 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 00:59:55.299794 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-0643bcd6-25e4-4dbc-9d0c-ced06507c593 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:55.307584 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-0643bcd6-25e4-4dbc-9d0c-ced06507c593 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/8638d924-308a-4f2b-945e-5798c738ee45" status: 200 len: 1267 microversion: 2.1 time: 0.164230 Aug 26 00:59:55.308340 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 378/757] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:59:55 2022] GET /compute/v2.1/servers/8638d924-308a-4f2b-945e-5798c738ee45 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:59:55.333220 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-db8088c5-40f3-43ab-b505-5a70b12255cb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:55.333705 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-db8088c5-40f3-43ab-b505-5a70b12255cb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:55.339765 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-db8088c5-40f3-43ab-b505-5a70b12255cb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:55.340204 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-db8088c5-40f3-43ab-b505-5a70b12255cb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:55.340656 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-db8088c5-40f3-43ab-b505-5a70b12255cb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:55.341342 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-db8088c5-40f3-43ab-b505-5a70b12255cb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:55.341779 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-db8088c5-40f3-43ab-b505-5a70b12255cb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:55.342194 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-db8088c5-40f3-43ab-b505-5a70b12255cb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:55.637340 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-c6c2ad73-c604-4078-b612-2b51122177b8 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:55.637985 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-c6c2ad73-c604-4078-b612-2b51122177b8 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] [instance: 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:55.644575 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c6c2ad73-c604-4078-b612-2b51122177b8 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:55.648239 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c6c2ad73-c604-4078-b612-2b51122177b8 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:55.648239 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c6c2ad73-c604-4078-b612-2b51122177b8 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:55.648239 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c6c2ad73-c604-4078-b612-2b51122177b8 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:55.648239 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c6c2ad73-c604-4078-b612-2b51122177b8 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:55.648692 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c6c2ad73-c604-4078-b612-2b51122177b8 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:55.660637 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.wsgi [None req-c6c2ad73-c604-4078-b612-2b51122177b8 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] HTTP exception thrown: Instance 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab could not be found. Aug 26 00:59:55.662288 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-c6c2ad73-c604-4078-b612-2b51122177b8 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Request method failure captured: Aug 26 00:59:55.662288 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: request: GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab HTTP/1.1 Aug 26 00:59:55.662288 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Accept: application/json Aug 26 00:59:55.662288 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Accept-Encoding: identity Aug 26 00:59:55.662288 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Connection: close Aug 26 00:59:55.662288 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Content-Length: 0 Aug 26 00:59:55.662288 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Content-Type: application/json Aug 26 00:59:55.662288 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Host: 10.222.0.59 Aug 26 00:59:55.662288 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Openstack-System-Scope: None Aug 26 00:59:55.662288 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: User-Agent: python-urllib3/1.26.11 Aug 26 00:59:55.662288 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Auth-Token: gAAAAABjCBmefHFNNUqFlMUE7I3i-93USVXZAM-jGRx67LwRrBQPHws8Ly74cPkf0mck5rrbALQjBE8Uy7qr03rwitlw4-vjXBtSJZuAAkljOdu1vNSZ4iHfo9uVWiTpSJogUteHYoVEbCAE9IBTiJYBlMj1AATIr86-7txLA_xIrQ0LluUT1u0 Aug 26 00:59:55.662288 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Domain-Id: None Aug 26 00:59:55.662288 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Domain-Name: None Aug 26 00:59:55.662288 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Identity-Status: Confirmed Aug 26 00:59:55.662288 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Is-Admin-Project: True Aug 26 00:59:55.662288 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Domain-Id: default Aug 26 00:59:55.662288 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Domain-Name: Default Aug 26 00:59:55.662288 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Id: 368f6a9e030e4aff9ef6559a6a165975 Aug 26 00:59:55.662288 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-988292211 Aug 26 00:59:55.662288 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Role: reader,member Aug 26 00:59:55.662288 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Roles: reader,member Aug 26 00:59:55.664211 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_368f6a9e030e4aff9ef6559a6a165975"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/368f6a9e030e4aff9ef6559a6a165975"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/368f6a9e030e4aff9ef6559a6a165975"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/368f6a9e030e4aff9ef6559a6a165975"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 00:59:55.664211 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant: tempest-ServerRescueNegativeTestJSON-988292211 Aug 26 00:59:55.664211 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant-Id: 368f6a9e030e4aff9ef6559a6a165975 Aug 26 00:59:55.664211 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-988292211 Aug 26 00:59:55.664211 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User: tempest-ServerRescueNegativeTestJSON-988292211-project Aug 26 00:59:55.664211 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Domain-Id: default Aug 26 00:59:55.664211 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Domain-Name: Default Aug 26 00:59:55.664211 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Id: 0cc36def73aa4bedb9e79d4cf11f5e8c Aug 26 00:59:55.664211 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Name: tempest-ServerRescueNegativeTestJSON-988292211-project Aug 26 00:59:55.664211 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: method: > Aug 26 00:59:55.664211 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: exception: Instance 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab could not be found. Aug 26 00:59:55.664211 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: action_args: {'id': '3079fdb4-9b6d-4030-a7ce-bdf5bff324ab'} Aug 26 00:59:55.665394 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 00:59:55.665394 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:59:55.665394 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 00:59:55.665394 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 00:59:55.665394 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 00:59:55.665394 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 00:59:55.665394 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 00:59:55.665394 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 00:59:55.665394 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 00:59:55.665394 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 00:59:55.665394 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab could not be found. Aug 26 00:59:55.665394 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:59:55.665394 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 00:59:55.665394 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:59:55.665394 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:59:55.665394 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 00:59:55.665394 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 00:59:55.665394 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 00:59:55.665394 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 00:59:55.665394 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 00:59:55.666920 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 00:59:55.666920 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 00:59:55.666920 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 00:59:55.666920 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 00:59:55.666920 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 00:59:55.666920 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 00:59:55.666920 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 00:59:55.666920 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab could not be found. Aug 26 00:59:55.666920 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:59:55.666920 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 00:59:55.666920 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:59:55.666920 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 00:59:55.666920 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 00:59:55.666920 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 00:59:55.666920 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 00:59:55.666920 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 00:59:55.666920 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab could not be found. Aug 26 00:59:55.666920 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 00:59:55.668556 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-c6c2ad73-c604-4078-b612-2b51122177b8 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] Returning 404 to user: Instance 3079fdb4-9b6d-4030-a7ce-bdf5bff324ab could not be found. {{(pid=127565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 00:59:55.668556 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-c6c2ad73-c604-4078-b612-2b51122177b8 tempest-ServerRescueNegativeTestJSON-988292211 tempest-ServerRescueNegativeTestJSON-988292211-project] 10.222.0.59 "GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab" status: 404 len: 111 microversion: 2.1 time: 0.030675 Aug 26 00:59:55.668556 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 379/758] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:59:55 2022] GET /compute/v2.1/servers/3079fdb4-9b6d-4030-a7ce-bdf5bff324ab => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 00:59:55.980348 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-db8088c5-40f3-43ab-b505-5a70b12255cb tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "DELETE /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec/os-volume_attachments/76fa929d-be46-4579-89d3-e11855e0d44d" status: 202 len: 0 microversion: 2.20 time: 0.651042 Aug 26 00:59:55.980908 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 380/759] 10.222.0.59 () {60 vars in 1457 bytes} [Fri Aug 26 00:59:55 2022] DELETE /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec/os-volume_attachments/76fa929d-be46-4579-89d3-e11855e0d44d => generated 0 bytes in 652 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 26 00:59:56.043191 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-937a2cb4-ad06-4b26-8d73-c2ead76a6909 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:59:56.043777 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-937a2cb4-ad06-4b26-8d73-c2ead76a6909 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:56.050261 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-937a2cb4-ad06-4b26-8d73-c2ead76a6909 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:56.050740 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-937a2cb4-ad06-4b26-8d73-c2ead76a6909 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:56.051169 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-937a2cb4-ad06-4b26-8d73-c2ead76a6909 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:56.051850 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-937a2cb4-ad06-4b26-8d73-c2ead76a6909 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:56.052295 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-937a2cb4-ad06-4b26-8d73-c2ead76a6909 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:56.052790 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-937a2cb4-ad06-4b26-8d73-c2ead76a6909 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:56.096529 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-937a2cb4-ad06-4b26-8d73-c2ead76a6909 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127565) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 26 00:59:56.328671 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-a91eda9c-6deb-4172-8863-ed4661fa3c22 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:56.329654 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-a91eda9c-6deb-4172-8863-ed4661fa3c22 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: 8638d924-308a-4f2b-945e-5798c738ee45] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:56.336819 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a91eda9c-6deb-4172-8863-ed4661fa3c22 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:56.337407 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a91eda9c-6deb-4172-8863-ed4661fa3c22 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:56.338326 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a91eda9c-6deb-4172-8863-ed4661fa3c22 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:56.338767 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a91eda9c-6deb-4172-8863-ed4661fa3c22 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:56.339329 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a91eda9c-6deb-4172-8863-ed4661fa3c22 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:56.339850 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a91eda9c-6deb-4172-8863-ed4661fa3c22 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:56.344697 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-937a2cb4-ad06-4b26-8d73-c2ead76a6909 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "POST /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec/action" status: 202 len: 0 microversion: 2.20 time: 0.304044 Aug 26 00:59:56.346817 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 380/760] 10.222.0.59 () {62 vars in 1319 bytes} [Fri Aug 26 00:59:56 2022] POST /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 26 00:59:56.353610 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-3d34041d-6066-45e6-b7b5-88af715de0c1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:56.354218 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-3d34041d-6066-45e6-b7b5-88af715de0c1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:56.373436 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3d34041d-6066-45e6-b7b5-88af715de0c1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:56.373921 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3d34041d-6066-45e6-b7b5-88af715de0c1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:56.374345 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3d34041d-6066-45e6-b7b5-88af715de0c1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:56.375038 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3d34041d-6066-45e6-b7b5-88af715de0c1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:56.375477 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3d34041d-6066-45e6-b7b5-88af715de0c1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:56.375889 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3d34041d-6066-45e6-b7b5-88af715de0c1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:56.535908 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-3d34041d-6066-45e6-b7b5-88af715de0c1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:56.545888 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-3d34041d-6066-45e6-b7b5-88af715de0c1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:56.547631 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-3d34041d-6066-45e6-b7b5-88af715de0c1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:56.549052 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-3d34041d-6066-45e6-b7b5-88af715de0c1 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 200 len: 1672 microversion: 2.20 time: 0.199215 Aug 26 00:59:56.549800 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 381/761] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:59:56 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 1672 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 00:59:56.568428 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-a91eda9c-6deb-4172-8863-ed4661fa3c22 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:56.577614 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-a91eda9c-6deb-4172-8863-ed4661fa3c22 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/8638d924-308a-4f2b-945e-5798c738ee45" status: 200 len: 1267 microversion: 2.1 time: 0.252847 Aug 26 00:59:56.578433 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 381/762] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:59:56 2022] GET /compute/v2.1/servers/8638d924-308a-4f2b-945e-5798c738ee45 => generated 1267 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:59:57.572697 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-6cc0667a-03b6-4c38-aa68-c4a0673e6ea5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:57.573311 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-6cc0667a-03b6-4c38-aa68-c4a0673e6ea5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:57.581082 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6cc0667a-03b6-4c38-aa68-c4a0673e6ea5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:57.581462 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6cc0667a-03b6-4c38-aa68-c4a0673e6ea5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:57.582084 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6cc0667a-03b6-4c38-aa68-c4a0673e6ea5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:57.582957 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6cc0667a-03b6-4c38-aa68-c4a0673e6ea5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:57.583409 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6cc0667a-03b6-4c38-aa68-c4a0673e6ea5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:57.583841 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6cc0667a-03b6-4c38-aa68-c4a0673e6ea5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:57.599336 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-ca0dc089-83a6-4055-84e9-4e0dc672570d tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:57.599966 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-ca0dc089-83a6-4055-84e9-4e0dc672570d tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: 8638d924-308a-4f2b-945e-5798c738ee45] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:57.614507 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ca0dc089-83a6-4055-84e9-4e0dc672570d tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:57.615007 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ca0dc089-83a6-4055-84e9-4e0dc672570d tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:57.615445 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ca0dc089-83a6-4055-84e9-4e0dc672570d tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:57.616352 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ca0dc089-83a6-4055-84e9-4e0dc672570d tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:57.616865 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ca0dc089-83a6-4055-84e9-4e0dc672570d tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:57.617296 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ca0dc089-83a6-4055-84e9-4e0dc672570d tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:57.808606 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-ca0dc089-83a6-4055-84e9-4e0dc672570d tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:57.824114 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-ca0dc089-83a6-4055-84e9-4e0dc672570d tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/8638d924-308a-4f2b-945e-5798c738ee45" status: 200 len: 1267 microversion: 2.1 time: 0.227991 Aug 26 00:59:57.825518 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 382/763] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:59:57 2022] GET /compute/v2.1/servers/8638d924-308a-4f2b-945e-5798c738ee45 => generated 1267 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 00:59:57.872055 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-6cc0667a-03b6-4c38-aa68-c4a0673e6ea5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:57.881415 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-6cc0667a-03b6-4c38-aa68-c4a0673e6ea5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:57.883096 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-6cc0667a-03b6-4c38-aa68-c4a0673e6ea5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:57.884274 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-6cc0667a-03b6-4c38-aa68-c4a0673e6ea5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 200 len: 1672 microversion: 2.20 time: 0.316503 Aug 26 00:59:57.884851 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 382/764] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:59:57 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 1672 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 00:59:58.496570 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-98a4aabb-63b6-44c9-b3c0-ba29df1728e3 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:58.497306 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-98a4aabb-63b6-44c9-b3c0-ba29df1728e3 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 33bd7c7e-1f1c-4d78-9a79-142e4f5c3478] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:58.506152 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-98a4aabb-63b6-44c9-b3c0-ba29df1728e3 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:58.506719 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-98a4aabb-63b6-44c9-b3c0-ba29df1728e3 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:58.507224 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-98a4aabb-63b6-44c9-b3c0-ba29df1728e3 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:58.508106 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-98a4aabb-63b6-44c9-b3c0-ba29df1728e3 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:58.508882 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-98a4aabb-63b6-44c9-b3c0-ba29df1728e3 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:58.509472 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-98a4aabb-63b6-44c9-b3c0-ba29df1728e3 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:58.517772 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [req-ff17e9d5-0fd1-44af-bf5f-d06c3a1fcb1a req-e8238af7-41a5-47ec-befb-b604bd5203ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8638d924-308a-4f2b-945e-5798c738ee45", "name": "network-vif-plugged", "status": "completed", "tag": "ea9f0339-afc5-4a08-9e7f-4f43f30fd859"}]} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 00:59:58.536868 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-ff17e9d5-0fd1-44af-bf5f-d06c3a1fcb1a req-e8238af7-41a5-47ec-befb-b604bd5203ca service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:58.537530 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-98a4aabb-63b6-44c9-b3c0-ba29df1728e3 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478/ips" status: 200 len: 147 microversion: 2.1 time: 0.044900 Aug 26 00:59:58.537673 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-ff17e9d5-0fd1-44af-bf5f-d06c3a1fcb1a req-e8238af7-41a5-47ec-befb-b604bd5203ca service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:58.538277 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-ff17e9d5-0fd1-44af-bf5f-d06c3a1fcb1a req-e8238af7-41a5-47ec-befb-b604bd5203ca service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:58.539233 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 383/765] 10.222.0.59 () {58 vars in 1248 bytes} [Fri Aug 26 00:59:58 2022] GET /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478/ips => generated 147 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 00:59:58.551287 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.compute.server_external_events [req-ff17e9d5-0fd1-44af-bf5f-d06c3a1fcb1a req-e8238af7-41a5-47ec-befb-b604bd5203ca service nova] Creating event network-vif-plugged:ea9f0339-afc5-4a08-9e7f-4f43f30fd859 for instance 8638d924-308a-4f2b-945e-5798c738ee45 on hv-cinder-83538 Aug 26 00:59:58.557224 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [req-ff17e9d5-0fd1-44af-bf5f-d06c3a1fcb1a req-e8238af7-41a5-47ec-befb-b604bd5203ca service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043037 Aug 26 00:59:58.557932 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 383/766] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 00:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 00:59:58.846785 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-894c2fd1-93ad-407b-9921-269cae94040c tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:58.847449 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-894c2fd1-93ad-407b-9921-269cae94040c tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: 8638d924-308a-4f2b-945e-5798c738ee45] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:58.853968 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-894c2fd1-93ad-407b-9921-269cae94040c tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:58.854449 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-894c2fd1-93ad-407b-9921-269cae94040c tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:58.855078 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-894c2fd1-93ad-407b-9921-269cae94040c tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:58.855787 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-894c2fd1-93ad-407b-9921-269cae94040c tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:58.856237 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-894c2fd1-93ad-407b-9921-269cae94040c tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:58.856696 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-894c2fd1-93ad-407b-9921-269cae94040c tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:58.910668 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-dd0c813c-abdf-47db-b2b3-4d5a1b6e53f9 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 00:59:58.911497 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-dd0c813c-abdf-47db-b2b3-4d5a1b6e53f9 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 00:59:58.918637 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-dd0c813c-abdf-47db-b2b3-4d5a1b6e53f9 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:58.919542 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-dd0c813c-abdf-47db-b2b3-4d5a1b6e53f9 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:58.920217 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-dd0c813c-abdf-47db-b2b3-4d5a1b6e53f9 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:58.921495 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-dd0c813c-abdf-47db-b2b3-4d5a1b6e53f9 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 00:59:58.922109 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-dd0c813c-abdf-47db-b2b3-4d5a1b6e53f9 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 00:59:58.922685 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-dd0c813c-abdf-47db-b2b3-4d5a1b6e53f9 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 00:59:59.118492 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-dd0c813c-abdf-47db-b2b3-4d5a1b6e53f9 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:59.131576 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-dd0c813c-abdf-47db-b2b3-4d5a1b6e53f9 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:59.134003 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-dd0c813c-abdf-47db-b2b3-4d5a1b6e53f9 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:59.135653 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-dd0c813c-abdf-47db-b2b3-4d5a1b6e53f9 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 200 len: 1730 microversion: 2.20 time: 0.230515 Aug 26 00:59:59.150557 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 384/767] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 00:59:58 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 1730 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 00:59:59.168333 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-894c2fd1-93ad-407b-9921-269cae94040c tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 00:59:59.176195 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-894c2fd1-93ad-407b-9921-269cae94040c tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/8638d924-308a-4f2b-945e-5798c738ee45" status: 200 len: 1267 microversion: 2.1 time: 0.333757 Aug 26 00:59:59.190186 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 384/768] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 00:59:58 2022] GET /compute/v2.1/servers/8638d924-308a-4f2b-945e-5798c738ee45 => generated 1267 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:00:00.159181 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-8837a75d-1af3-405a-860b-d233bea09b3c tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:00.159823 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-8837a75d-1af3-405a-860b-d233bea09b3c tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:00:00.167469 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8837a75d-1af3-405a-860b-d233bea09b3c tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:00.167960 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8837a75d-1af3-405a-860b-d233bea09b3c tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:00.168396 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8837a75d-1af3-405a-860b-d233bea09b3c tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:00.169128 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8837a75d-1af3-405a-860b-d233bea09b3c tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:00.169616 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8837a75d-1af3-405a-860b-d233bea09b3c tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:00.170027 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8837a75d-1af3-405a-860b-d233bea09b3c tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:00.198962 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-a55892ad-d8f1-4bdd-9f4d-7d12404ae146 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:00.199639 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-a55892ad-d8f1-4bdd-9f4d-7d12404ae146 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: 8638d924-308a-4f2b-945e-5798c738ee45] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:00:00.219152 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a55892ad-d8f1-4bdd-9f4d-7d12404ae146 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:00.219639 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a55892ad-d8f1-4bdd-9f4d-7d12404ae146 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:00.220099 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a55892ad-d8f1-4bdd-9f4d-7d12404ae146 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:00.221010 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a55892ad-d8f1-4bdd-9f4d-7d12404ae146 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:00.221659 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a55892ad-d8f1-4bdd-9f4d-7d12404ae146 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:00.222076 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a55892ad-d8f1-4bdd-9f4d-7d12404ae146 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:00.333033 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-8837a75d-1af3-405a-860b-d233bea09b3c tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:00.342699 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-8837a75d-1af3-405a-860b-d233bea09b3c tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:00.344255 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-8837a75d-1af3-405a-860b-d233bea09b3c tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:00.345592 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-8837a75d-1af3-405a-860b-d233bea09b3c tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 200 len: 1730 microversion: 2.20 time: 0.190369 Aug 26 01:00:00.346688 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 385/769] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 01:00:00 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 1730 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 01:00:00.354103 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-a9b4be05-030f-4429-af37-a88970bbaad2 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f16bc71b-4c1b-4653-8fcd-52c6d555fd59"}} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:00:00.356774 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-a9b4be05-030f-4429-af37-a88970bbaad2 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 33bd7c7e-1f1c-4d78-9a79-142e4f5c3478] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:00:00.368597 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a9b4be05-030f-4429-af37-a88970bbaad2 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:00.369094 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a9b4be05-030f-4429-af37-a88970bbaad2 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:00.369551 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a9b4be05-030f-4429-af37-a88970bbaad2 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:00.370430 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a9b4be05-030f-4429-af37-a88970bbaad2 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:00.370895 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a9b4be05-030f-4429-af37-a88970bbaad2 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:00.371962 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a9b4be05-030f-4429-af37-a88970bbaad2 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:00.376645 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:00:00.436393 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-a55892ad-d8f1-4bdd-9f4d-7d12404ae146 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:00.443702 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-a55892ad-d8f1-4bdd-9f4d-7d12404ae146 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/8638d924-308a-4f2b-945e-5798c738ee45" status: 200 len: 1267 microversion: 2.1 time: 0.247971 Aug 26 01:00:00.443812 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 385/770] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:00:00 2022] GET /compute/v2.1/servers/8638d924-308a-4f2b-945e-5798c738ee45 => generated 1267 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:00:01.372456 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-44555cff-d6f8-4146-be42-22ae183aa24b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:01.373416 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-44555cff-d6f8-4146-be42-22ae183aa24b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:00:01.375264 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:00:01.382756 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-44555cff-d6f8-4146-be42-22ae183aa24b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:01.383255 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-44555cff-d6f8-4146-be42-22ae183aa24b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:01.383841 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-44555cff-d6f8-4146-be42-22ae183aa24b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:01.384572 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-44555cff-d6f8-4146-be42-22ae183aa24b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:01.385071 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-44555cff-d6f8-4146-be42-22ae183aa24b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:01.398168 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-44555cff-d6f8-4146-be42-22ae183aa24b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:01.511428 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-a9b4be05-030f-4429-af37-a88970bbaad2 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "POST /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.163153 Aug 26 01:00:01.512041 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 386/771] 10.222.0.59 () {60 vars in 1323 bytes} [Fri Aug 26 01:00:00 2022] POST /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478/os-volume_attachments => generated 194 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:00:01.524356 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-59bcc6e2-99d8-49c7-a145-d8e7435491c7 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:01.524356 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-59bcc6e2-99d8-49c7-a145-d8e7435491c7 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: 8638d924-308a-4f2b-945e-5798c738ee45] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:00:01.530782 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-59bcc6e2-99d8-49c7-a145-d8e7435491c7 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:01.531195 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-59bcc6e2-99d8-49c7-a145-d8e7435491c7 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:01.531869 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-59bcc6e2-99d8-49c7-a145-d8e7435491c7 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:01.533078 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-59bcc6e2-99d8-49c7-a145-d8e7435491c7 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:01.534492 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-59bcc6e2-99d8-49c7-a145-d8e7435491c7 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:01.535119 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-59bcc6e2-99d8-49c7-a145-d8e7435491c7 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:01.571776 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-44555cff-d6f8-4146-be42-22ae183aa24b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:01.583751 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-44555cff-d6f8-4146-be42-22ae183aa24b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:01.585940 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-44555cff-d6f8-4146-be42-22ae183aa24b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:01.587101 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-44555cff-d6f8-4146-be42-22ae183aa24b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 200 len: 1730 microversion: 2.20 time: 0.219042 Aug 26 01:00:01.588603 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 386/772] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 01:00:01 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 1730 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 01:00:01.715981 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-59bcc6e2-99d8-49c7-a145-d8e7435491c7 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:01.725375 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-59bcc6e2-99d8-49c7-a145-d8e7435491c7 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/8638d924-308a-4f2b-945e-5798c738ee45" status: 200 len: 1454 microversion: 2.1 time: 0.211941 Aug 26 01:00:01.725986 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 387/773] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:00:01 2022] GET /compute/v2.1/servers/8638d924-308a-4f2b-945e-5798c738ee45 => generated 1454 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:00:01.753499 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-560adcd3-8675-412d-89c2-42072e511766 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:01.754263 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-560adcd3-8675-412d-89c2-42072e511766 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: 8638d924-308a-4f2b-945e-5798c738ee45] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:00:01.760841 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-560adcd3-8675-412d-89c2-42072e511766 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:01.761541 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-560adcd3-8675-412d-89c2-42072e511766 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:01.761981 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-560adcd3-8675-412d-89c2-42072e511766 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:01.762946 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-560adcd3-8675-412d-89c2-42072e511766 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:01.763641 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-560adcd3-8675-412d-89c2-42072e511766 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:01.764535 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-560adcd3-8675-412d-89c2-42072e511766 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:01.927544 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-560adcd3-8675-412d-89c2-42072e511766 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:01.939178 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-560adcd3-8675-412d-89c2-42072e511766 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/8638d924-308a-4f2b-945e-5798c738ee45" status: 200 len: 1454 microversion: 2.1 time: 0.188254 Aug 26 01:00:01.957837 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 387/774] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:00:01 2022] GET /compute/v2.1/servers/8638d924-308a-4f2b-945e-5798c738ee45 => generated 1454 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 01:00:02.528682 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-dc8c4db9-b7b3-451b-b2fb-e0029fab2359 tempest-VolumesSnapshotsTestJSON-1394051177 tempest-VolumesSnapshotsTestJSON-1394051177-project] Action: 'create', calling method: .version_select at 0x7f8a92c488b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-797742495"}} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:00:02.615344 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-eab8e02b-8a01-4b09-b313-902003dac427 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:02.619299 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-eab8e02b-8a01-4b09-b313-902003dac427 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:00:02.622952 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-eab8e02b-8a01-4b09-b313-902003dac427 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:02.623644 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-eab8e02b-8a01-4b09-b313-902003dac427 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:02.627620 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-eab8e02b-8a01-4b09-b313-902003dac427 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:02.628367 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-eab8e02b-8a01-4b09-b313-902003dac427 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:02.628865 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-eab8e02b-8a01-4b09-b313-902003dac427 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:02.629287 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-eab8e02b-8a01-4b09-b313-902003dac427 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:02.660199 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:00:02.840924 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-eab8e02b-8a01-4b09-b313-902003dac427 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:02.853482 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-eab8e02b-8a01-4b09-b313-902003dac427 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:02.856620 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-eab8e02b-8a01-4b09-b313-902003dac427 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:02.858091 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-eab8e02b-8a01-4b09-b313-902003dac427 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 200 len: 1730 microversion: 2.20 time: 0.246670 Aug 26 01:00:02.860456 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 388/775] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 01:00:02 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 1730 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 01:00:03.367174 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-dc8c4db9-b7b3-451b-b2fb-e0029fab2359 tempest-VolumesSnapshotsTestJSON-1394051177 tempest-VolumesSnapshotsTestJSON-1394051177-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.991878 Aug 26 01:00:03.368153 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 388/776] 10.222.0.59 () {60 vars in 1155 bytes} [Fri Aug 26 01:00:02 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 994 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 26 01:00:03.381905 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-f68dcbff-ee41-402b-9c04-58506d89f637 tempest-VolumesSnapshotsTestJSON-1394051177 tempest-VolumesSnapshotsTestJSON-1394051177-project] Calling method '.version_select at 0x7f8a92e79790>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:03.481957 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-f68dcbff-ee41-402b-9c04-58506d89f637 tempest-VolumesSnapshotsTestJSON-1394051177 tempest-VolumesSnapshotsTestJSON-1394051177-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/0262da60-0880-4fab-a0b4-6e0bc210d624" status: 200 len: 344 microversion: 2.1 time: 0.103569 Aug 26 01:00:03.488683 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 389/777] 10.222.0.59 () {58 vars in 1245 bytes} [Fri Aug 26 01:00:03 2022] GET /compute/v2.1/os-volumes/0262da60-0880-4fab-a0b4-6e0bc210d624 => generated 344 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:00:03.893908 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-6317ea20-9606-4cf2-a5b2-af95197076cd tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:03.895098 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-6317ea20-9606-4cf2-a5b2-af95197076cd tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:00:03.904100 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6317ea20-9606-4cf2-a5b2-af95197076cd tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:03.904908 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6317ea20-9606-4cf2-a5b2-af95197076cd tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:03.905359 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6317ea20-9606-4cf2-a5b2-af95197076cd tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:03.906065 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6317ea20-9606-4cf2-a5b2-af95197076cd tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:03.906512 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6317ea20-9606-4cf2-a5b2-af95197076cd tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:03.912618 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6317ea20-9606-4cf2-a5b2-af95197076cd tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:04.144379 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-6317ea20-9606-4cf2-a5b2-af95197076cd tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:04.157600 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-6317ea20-9606-4cf2-a5b2-af95197076cd tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:04.159894 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-6317ea20-9606-4cf2-a5b2-af95197076cd tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:04.164232 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-6317ea20-9606-4cf2-a5b2-af95197076cd tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 200 len: 1730 microversion: 2.20 time: 0.274857 Aug 26 01:00:04.171297 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 389/778] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 01:00:03 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 1730 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 01:00:04.477437 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [req-b0c41759-0754-4414-bd25-37ccd852eea1 req-08f36a4d-3212-490c-b3de-cd2c7c39474e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8638d924-308a-4f2b-945e-5798c738ee45", "tag": "ea9f0339-afc5-4a08-9e7f-4f43f30fd859"}]} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:00:04.488093 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-b0c41759-0754-4414-bd25-37ccd852eea1 req-08f36a4d-3212-490c-b3de-cd2c7c39474e service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:04.488604 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-b0c41759-0754-4414-bd25-37ccd852eea1 req-08f36a4d-3212-490c-b3de-cd2c7c39474e service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:04.489216 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-b0c41759-0754-4414-bd25-37ccd852eea1 req-08f36a4d-3212-490c-b3de-cd2c7c39474e service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:04.498568 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-035b4b0d-2b3b-4d38-8a96-7d296d99517e tempest-VolumesSnapshotsTestJSON-1394051177 tempest-VolumesSnapshotsTestJSON-1394051177-project] Calling method '.version_select at 0x7f8a92c91d30>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:04.514345 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.compute.server_external_events [req-b0c41759-0754-4414-bd25-37ccd852eea1 req-08f36a4d-3212-490c-b3de-cd2c7c39474e service nova] Creating event network-changed:ea9f0339-afc5-4a08-9e7f-4f43f30fd859 for instance 8638d924-308a-4f2b-945e-5798c738ee45 on hv-cinder-83538 Aug 26 01:00:04.520616 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [req-b0c41759-0754-4414-bd25-37ccd852eea1 req-08f36a4d-3212-490c-b3de-cd2c7c39474e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047822 Aug 26 01:00:04.521753 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 390/779] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 01:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:00:04.566372 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-035b4b0d-2b3b-4d38-8a96-7d296d99517e tempest-VolumesSnapshotsTestJSON-1394051177 tempest-VolumesSnapshotsTestJSON-1394051177-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/0262da60-0880-4fab-a0b4-6e0bc210d624" status: 200 len: 345 microversion: 2.1 time: 0.073667 Aug 26 01:00:04.567374 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 390/780] 10.222.0.59 () {58 vars in 1245 bytes} [Fri Aug 26 01:00:04 2022] GET /compute/v2.1/os-volumes/0262da60-0880-4fab-a0b4-6e0bc210d624 => generated 345 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:00:04.580137 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-1bc271ee-e181-4858-9ae0-f9d96f6a738a tempest-VolumesSnapshotsTestJSON-1394051177 tempest-VolumesSnapshotsTestJSON-1394051177-project] Action: 'create', calling method: .version_select at 0x7f8a92dced30>, body: {"snapshot": {"volume_id": "0262da60-0880-4fab-a0b4-6e0bc210d624", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1602733721"}} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:00:05.123811 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-1bc271ee-e181-4858-9ae0-f9d96f6a738a tempest-VolumesSnapshotsTestJSON-1394051177 tempest-VolumesSnapshotsTestJSON-1394051177-project] 10.222.0.59 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.547906 Aug 26 01:00:05.124403 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 391/781] 10.222.0.59 () {60 vars in 1162 bytes} [Fri Aug 26 01:00:04 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:00:05.137280 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-7a17a8c8-2d92-4405-b40a-3061f8829b88 tempest-VolumesSnapshotsTestJSON-1394051177 tempest-VolumesSnapshotsTestJSON-1394051177-project] Calling method '.version_select at 0x7f8a92c93d30>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:05.177206 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-7a17a8c8-2d92-4405-b40a-3061f8829b88 tempest-VolumesSnapshotsTestJSON-1394051177 tempest-VolumesSnapshotsTestJSON-1394051177-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/ea5fc136-c12e-4cf1-b633-a87170421433" status: 200 len: 287 microversion: 2.1 time: 0.044542 Aug 26 01:00:05.178072 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 391/782] 10.222.0.59 () {58 vars in 1251 bytes} [Fri Aug 26 01:00:05 2022] GET /compute/v2.1/os-snapshots/ea5fc136-c12e-4cf1-b633-a87170421433 => generated 287 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:00:05.188621 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-6f6304dd-4717-4577-b6b3-2e8898897fbb tempest-VolumesSnapshotsTestJSON-1394051177 tempest-VolumesSnapshotsTestJSON-1394051177-project] Calling method '.version_select at 0x7f8a966fadc0>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:05.198412 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-3f898659-0a8f-41cd-a1e2-50937748c054 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:05.199178 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-3f898659-0a8f-41cd-a1e2-50937748c054 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:00:05.213472 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3f898659-0a8f-41cd-a1e2-50937748c054 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:05.214213 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3f898659-0a8f-41cd-a1e2-50937748c054 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:05.214890 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3f898659-0a8f-41cd-a1e2-50937748c054 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:05.215844 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3f898659-0a8f-41cd-a1e2-50937748c054 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:05.216386 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3f898659-0a8f-41cd-a1e2-50937748c054 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:05.216967 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3f898659-0a8f-41cd-a1e2-50937748c054 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:05.258293 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-6f6304dd-4717-4577-b6b3-2e8898897fbb tempest-VolumesSnapshotsTestJSON-1394051177 tempest-VolumesSnapshotsTestJSON-1394051177-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.073541 Aug 26 01:00:05.258864 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 392/783] 10.222.0.59 () {58 vars in 1140 bytes} [Fri Aug 26 01:00:05 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:00:05.282546 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-f573425e-7786-43a8-840c-97e7f1fdc53e tempest-VolumesSnapshotsTestJSON-1394051177 tempest-VolumesSnapshotsTestJSON-1394051177-project] Calling method '.version_select at 0x7f8a966e0b80>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:05.320234 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-f573425e-7786-43a8-840c-97e7f1fdc53e tempest-VolumesSnapshotsTestJSON-1394051177 tempest-VolumesSnapshotsTestJSON-1394051177-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/ea5fc136-c12e-4cf1-b633-a87170421433" status: 200 len: 287 microversion: 2.1 time: 0.048388 Aug 26 01:00:05.324522 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 393/784] 10.222.0.59 () {58 vars in 1251 bytes} [Fri Aug 26 01:00:05 2022] GET /compute/v2.1/os-snapshots/ea5fc136-c12e-4cf1-b633-a87170421433 => generated 287 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 01:00:05.446534 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-3f898659-0a8f-41cd-a1e2-50937748c054 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:05.455914 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-3f898659-0a8f-41cd-a1e2-50937748c054 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:05.457389 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-3f898659-0a8f-41cd-a1e2-50937748c054 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:05.458580 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-3f898659-0a8f-41cd-a1e2-50937748c054 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 200 len: 1730 microversion: 2.20 time: 0.264074 Aug 26 01:00:05.459413 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 392/785] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 01:00:05 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 1730 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 01:00:06.333602 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-c49583fa-1244-4411-9bba-0877469665fa tempest-VolumesSnapshotsTestJSON-1394051177 tempest-VolumesSnapshotsTestJSON-1394051177-project] Calling method '.version_select at 0x7f8a966faa60>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:06.363407 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-c49583fa-1244-4411-9bba-0877469665fa tempest-VolumesSnapshotsTestJSON-1394051177 tempest-VolumesSnapshotsTestJSON-1394051177-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/ea5fc136-c12e-4cf1-b633-a87170421433" status: 200 len: 287 microversion: 2.1 time: 0.033647 Aug 26 01:00:06.363971 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 394/786] 10.222.0.59 () {58 vars in 1251 bytes} [Fri Aug 26 01:00:06 2022] GET /compute/v2.1/os-snapshots/ea5fc136-c12e-4cf1-b633-a87170421433 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:00:06.482433 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-52c44498-4bd9-48f8-bdb8-6b748d5c4b65 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:06.489878 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-52c44498-4bd9-48f8-bdb8-6b748d5c4b65 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:00:06.497016 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-52c44498-4bd9-48f8-bdb8-6b748d5c4b65 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:06.497456 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-52c44498-4bd9-48f8-bdb8-6b748d5c4b65 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:06.497888 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-52c44498-4bd9-48f8-bdb8-6b748d5c4b65 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:06.498585 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-52c44498-4bd9-48f8-bdb8-6b748d5c4b65 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:06.499029 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-52c44498-4bd9-48f8-bdb8-6b748d5c4b65 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:06.499452 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-52c44498-4bd9-48f8-bdb8-6b748d5c4b65 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:06.637959 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-52c44498-4bd9-48f8-bdb8-6b748d5c4b65 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:06.646399 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-52c44498-4bd9-48f8-bdb8-6b748d5c4b65 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:06.648059 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-52c44498-4bd9-48f8-bdb8-6b748d5c4b65 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:06.649587 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-52c44498-4bd9-48f8-bdb8-6b748d5c4b65 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 200 len: 1730 microversion: 2.20 time: 0.170901 Aug 26 01:00:06.650149 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 393/787] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 01:00:06 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 01:00:07.376612 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-7ef34c6b-58a9-4669-8952-936fe3ef9d4c tempest-VolumesSnapshotsTestJSON-1394051177 tempest-VolumesSnapshotsTestJSON-1394051177-project] Calling method '.version_select at 0x7f8a966fa3a0>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:07.411862 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-7ef34c6b-58a9-4669-8952-936fe3ef9d4c tempest-VolumesSnapshotsTestJSON-1394051177 tempest-VolumesSnapshotsTestJSON-1394051177-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/ea5fc136-c12e-4cf1-b633-a87170421433" status: 200 len: 287 microversion: 2.1 time: 0.040520 Aug 26 01:00:07.412444 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 395/788] 10.222.0.59 () {58 vars in 1251 bytes} [Fri Aug 26 01:00:07 2022] GET /compute/v2.1/os-snapshots/ea5fc136-c12e-4cf1-b633-a87170421433 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:00:07.673882 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-681ffa86-4935-4ef5-bf83-0bb5e0db87ee tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:07.675793 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-681ffa86-4935-4ef5-bf83-0bb5e0db87ee tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:00:07.684496 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-681ffa86-4935-4ef5-bf83-0bb5e0db87ee tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:07.685037 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-681ffa86-4935-4ef5-bf83-0bb5e0db87ee tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:07.685477 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-681ffa86-4935-4ef5-bf83-0bb5e0db87ee tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:07.686179 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-681ffa86-4935-4ef5-bf83-0bb5e0db87ee tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:07.686629 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-681ffa86-4935-4ef5-bf83-0bb5e0db87ee tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:07.687054 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-681ffa86-4935-4ef5-bf83-0bb5e0db87ee tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:07.828180 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-681ffa86-4935-4ef5-bf83-0bb5e0db87ee tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:07.837898 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-681ffa86-4935-4ef5-bf83-0bb5e0db87ee tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:07.839329 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-681ffa86-4935-4ef5-bf83-0bb5e0db87ee tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:07.840624 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-681ffa86-4935-4ef5-bf83-0bb5e0db87ee tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 200 len: 1730 microversion: 2.20 time: 0.171013 Aug 26 01:00:07.841187 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 394/789] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 01:00:07 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 01:00:08.425439 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-f2b855e3-7016-4ffa-8e72-544edcd05db7 tempest-VolumesSnapshotsTestJSON-1394051177 tempest-VolumesSnapshotsTestJSON-1394051177-project] Calling method '.version_select at 0x7f8a96713d30>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:08.457264 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-f2b855e3-7016-4ffa-8e72-544edcd05db7 tempest-VolumesSnapshotsTestJSON-1394051177 tempest-VolumesSnapshotsTestJSON-1394051177-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/ea5fc136-c12e-4cf1-b633-a87170421433" status: 200 len: 287 microversion: 2.1 time: 0.036298 Aug 26 01:00:08.458147 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 396/790] 10.222.0.59 () {58 vars in 1251 bytes} [Fri Aug 26 01:00:08 2022] GET /compute/v2.1/os-snapshots/ea5fc136-c12e-4cf1-b633-a87170421433 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:00:08.864698 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-792753df-33cc-430d-bab2-0238c1e00c0a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:08.865465 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-792753df-33cc-430d-bab2-0238c1e00c0a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:00:08.873037 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-792753df-33cc-430d-bab2-0238c1e00c0a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:08.873504 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-792753df-33cc-430d-bab2-0238c1e00c0a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:08.873934 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-792753df-33cc-430d-bab2-0238c1e00c0a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:08.874744 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-792753df-33cc-430d-bab2-0238c1e00c0a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:08.875312 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-792753df-33cc-430d-bab2-0238c1e00c0a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:08.875850 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-792753df-33cc-430d-bab2-0238c1e00c0a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:09.029039 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-792753df-33cc-430d-bab2-0238c1e00c0a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:09.039244 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-792753df-33cc-430d-bab2-0238c1e00c0a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:09.040738 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-792753df-33cc-430d-bab2-0238c1e00c0a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:09.041903 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-792753df-33cc-430d-bab2-0238c1e00c0a tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 200 len: 1730 microversion: 2.20 time: 0.181773 Aug 26 01:00:09.042736 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 395/791] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 01:00:08 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 1730 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 01:00:09.471258 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-3a2448bb-c6ec-4fa9-bbd7-4e0cb19f079f tempest-VolumesSnapshotsTestJSON-1394051177 tempest-VolumesSnapshotsTestJSON-1394051177-project] Calling method '.version_select at 0x7f8a92e79e50>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:09.503406 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-3a2448bb-c6ec-4fa9-bbd7-4e0cb19f079f tempest-VolumesSnapshotsTestJSON-1394051177 tempest-VolumesSnapshotsTestJSON-1394051177-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/ea5fc136-c12e-4cf1-b633-a87170421433" status: 200 len: 288 microversion: 2.1 time: 0.036720 Aug 26 01:00:09.504071 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 397/792] 10.222.0.59 () {58 vars in 1251 bytes} [Fri Aug 26 01:00:09 2022] GET /compute/v2.1/os-snapshots/ea5fc136-c12e-4cf1-b633-a87170421433 => generated 288 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:00:09.514991 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-0eb754d4-4d90-47c9-bcdf-eea6e880ee24 tempest-VolumesSnapshotsTestJSON-1394051177 tempest-VolumesSnapshotsTestJSON-1394051177-project] Calling method '.version_select at 0x7f8a92cd6940>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:09.661672 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-0eb754d4-4d90-47c9-bcdf-eea6e880ee24 tempest-VolumesSnapshotsTestJSON-1394051177 tempest-VolumesSnapshotsTestJSON-1394051177-project] 10.222.0.59 "DELETE /compute/v2.1/os-snapshots/ea5fc136-c12e-4cf1-b633-a87170421433" status: 202 len: 0 microversion: 2.1 time: 0.150421 Aug 26 01:00:09.662267 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 396/793] 10.222.0.59 () {58 vars in 1254 bytes} [Fri Aug 26 01:00:09 2022] DELETE /compute/v2.1/os-snapshots/ea5fc136-c12e-4cf1-b633-a87170421433 => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 26 01:00:09.671018 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-036bc204-807f-443f-9e60-2c68db42c7b3 tempest-VolumesSnapshotsTestJSON-1394051177 tempest-VolumesSnapshotsTestJSON-1394051177-project] Calling method '.version_select at 0x7f8a92e2dee0>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:09.708678 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-036bc204-807f-443f-9e60-2c68db42c7b3 tempest-VolumesSnapshotsTestJSON-1394051177 tempest-VolumesSnapshotsTestJSON-1394051177-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/ea5fc136-c12e-4cf1-b633-a87170421433" status: 200 len: 287 microversion: 2.1 time: 0.041684 Aug 26 01:00:09.709242 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 398/794] 10.222.0.59 () {58 vars in 1251 bytes} [Fri Aug 26 01:00:09 2022] GET /compute/v2.1/os-snapshots/ea5fc136-c12e-4cf1-b633-a87170421433 => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:00:10.065372 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-2bc3845a-d021-4745-8034-116bb6bae798 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:10.066005 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-2bc3845a-d021-4745-8034-116bb6bae798 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:00:10.072158 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2bc3845a-d021-4745-8034-116bb6bae798 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:10.072893 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2bc3845a-d021-4745-8034-116bb6bae798 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:10.073330 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2bc3845a-d021-4745-8034-116bb6bae798 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:10.074159 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2bc3845a-d021-4745-8034-116bb6bae798 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:10.074607 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2bc3845a-d021-4745-8034-116bb6bae798 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:10.075052 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2bc3845a-d021-4745-8034-116bb6bae798 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:10.207255 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-2bc3845a-d021-4745-8034-116bb6bae798 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:10.216019 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-2bc3845a-d021-4745-8034-116bb6bae798 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:10.220116 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-2bc3845a-d021-4745-8034-116bb6bae798 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:10.220116 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-2bc3845a-d021-4745-8034-116bb6bae798 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 200 len: 1730 microversion: 2.20 time: 0.158349 Aug 26 01:00:10.220116 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 397/795] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 01:00:10 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 01:00:10.721699 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-01aa93e2-8f48-452c-a54c-a4352f90bc89 tempest-VolumesSnapshotsTestJSON-1394051177 tempest-VolumesSnapshotsTestJSON-1394051177-project] Calling method '.version_select at 0x7f8a96713670>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:10.745592 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.wsgi [None req-01aa93e2-8f48-452c-a54c-a4352f90bc89 tempest-VolumesSnapshotsTestJSON-1394051177 tempest-VolumesSnapshotsTestJSON-1394051177-project] HTTP exception thrown: Snapshot ea5fc136-c12e-4cf1-b633-a87170421433 could not be found. Aug 26 01:00:10.747907 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-01aa93e2-8f48-452c-a54c-a4352f90bc89 tempest-VolumesSnapshotsTestJSON-1394051177 tempest-VolumesSnapshotsTestJSON-1394051177-project] Request method failure captured: Aug 26 01:00:10.747907 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: request: GET /compute/v2.1/os-snapshots/ea5fc136-c12e-4cf1-b633-a87170421433 HTTP/1.1 Aug 26 01:00:10.747907 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Accept: application/json Aug 26 01:00:10.747907 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Accept-Encoding: identity Aug 26 01:00:10.747907 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Connection: close Aug 26 01:00:10.747907 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Content-Length: 0 Aug 26 01:00:10.747907 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Content-Type: application/json Aug 26 01:00:10.747907 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Host: 10.222.0.59 Aug 26 01:00:10.747907 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Openstack-System-Scope: None Aug 26 01:00:10.747907 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: User-Agent: python-urllib3/1.26.11 Aug 26 01:00:10.747907 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Auth-Token: gAAAAABjCBsSnoRVpc5VXZYAJkF8_wj6cWK9z6as48uTaLWGckWFl-o2N48t3StYURJZzj5NFle43hM808EQxWV0gWcQED1rH4HkVjM_bT4M6bp_pqBEqh1lPHjMes1owxlMpZb5pdBMIFvGdg06pyfRd4S4VklkWJI_AhG5a8JN8P_aEJbpgF8 Aug 26 01:00:10.747907 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Domain-Id: None Aug 26 01:00:10.747907 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Domain-Name: None Aug 26 01:00:10.747907 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Identity-Status: Confirmed Aug 26 01:00:10.747907 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Is-Admin-Project: True Aug 26 01:00:10.747907 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Domain-Id: default Aug 26 01:00:10.747907 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Domain-Name: Default Aug 26 01:00:10.747907 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Id: 1173abf0d8774c4090d36ae3546c961b Aug 26 01:00:10.747907 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1394051177 Aug 26 01:00:10.747907 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Role: reader,member Aug 26 01:00:10.747907 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Roles: reader,member Aug 26 01:00:10.749428 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1173abf0d8774c4090d36ae3546c961b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1173abf0d8774c4090d36ae3546c961b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1173abf0d8774c4090d36ae3546c961b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1173abf0d8774c4090d36ae3546c961b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 01:00:10.749428 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1394051177 Aug 26 01:00:10.749428 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant-Id: 1173abf0d8774c4090d36ae3546c961b Aug 26 01:00:10.749428 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1394051177 Aug 26 01:00:10.749428 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User: tempest-VolumesSnapshotsTestJSON-1394051177-project Aug 26 01:00:10.749428 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Domain-Id: default Aug 26 01:00:10.749428 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Domain-Name: Default Aug 26 01:00:10.749428 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Id: 6853ce2599fa4099940e6a5791b756d1 Aug 26 01:00:10.749428 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1394051177-project Aug 26 01:00:10.749428 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: method: Aug 26 01:00:10.749428 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: exception: Snapshot ea5fc136-c12e-4cf1-b633-a87170421433 could not be found. Aug 26 01:00:10.749428 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: action_args: {'id': 'ea5fc136-c12e-4cf1-b633-a87170421433'} Aug 26 01:00:10.749428 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 01:00:10.750341 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:00:10.750341 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 26 01:00:10.750341 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 26 01:00:10.750341 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 26 01:00:10.750341 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 26 01:00:10.750341 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 26 01:00:10.750341 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 26 01:00:10.750341 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 01:00:10.750341 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 01:00:10.750341 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 01:00:10.750341 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 01:00:10.750341 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 01:00:10.750341 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 01:00:10.750341 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 01:00:10.750341 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 01:00:10.750341 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot ea5fc136-c12e-4cf1-b633-a87170421433 could not be found. (HTTP 404) (Request-ID: req-fc450161-35de-438c-8208-2ef851551315) Aug 26 01:00:10.750341 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:00:10.750341 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:00:10.751593 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:00:10.751593 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:00:10.751593 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 26 01:00:10.751593 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 26 01:00:10.751593 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 26 01:00:10.751593 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 26 01:00:10.751593 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 26 01:00:10.751593 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 26 01:00:10.751593 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 26 01:00:10.751593 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 26 01:00:10.751593 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 26 01:00:10.751593 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 26 01:00:10.751593 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 26 01:00:10.751593 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 26 01:00:10.751593 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 26 01:00:10.751593 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 26 01:00:10.751593 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 01:00:10.751593 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 01:00:10.751593 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 01:00:10.752817 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 01:00:10.752817 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 01:00:10.752817 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 01:00:10.752817 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 01:00:10.752817 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 01:00:10.752817 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot ea5fc136-c12e-4cf1-b633-a87170421433 could not be found. Aug 26 01:00:10.752817 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:00:10.752817 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:00:10.752817 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:00:10.752817 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:00:10.752817 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:00:10.752817 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:00:10.752817 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 01:00:10.752817 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 01:00:10.752817 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 01:00:10.752817 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 01:00:10.752817 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 01:00:10.752817 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 01:00:10.752817 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 26 01:00:10.752817 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 01:00:10.754501 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot ea5fc136-c12e-4cf1-b633-a87170421433 could not be found. Aug 26 01:00:10.754501 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:00:10.754501 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:00:10.754501 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:00:10.754501 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:00:10.754501 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:00:10.754501 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:00:10.754501 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 01:00:10.754501 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 01:00:10.754501 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot ea5fc136-c12e-4cf1-b633-a87170421433 could not be found. Aug 26 01:00:10.754501 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:00:10.754501 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-01aa93e2-8f48-452c-a54c-a4352f90bc89 tempest-VolumesSnapshotsTestJSON-1394051177 tempest-VolumesSnapshotsTestJSON-1394051177-project] Returning 404 to user: Snapshot ea5fc136-c12e-4cf1-b633-a87170421433 could not be found. {{(pid=127564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 01:00:10.754501 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-01aa93e2-8f48-452c-a54c-a4352f90bc89 tempest-VolumesSnapshotsTestJSON-1394051177 tempest-VolumesSnapshotsTestJSON-1394051177-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/ea5fc136-c12e-4cf1-b633-a87170421433" status: 404 len: 111 microversion: 2.1 time: 0.032257 Aug 26 01:00:10.755531 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 399/796] 10.222.0.59 () {58 vars in 1251 bytes} [Fri Aug 26 01:00:10 2022] GET /compute/v2.1/os-snapshots/ea5fc136-c12e-4cf1-b633-a87170421433 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 01:00:10.757856 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-1f649c86-41fe-4165-809a-45c8fa6cd6d2 tempest-VolumesSnapshotsTestJSON-1394051177 tempest-VolumesSnapshotsTestJSON-1394051177-project] Calling method '.version_select at 0x7f8a92cd6dc0>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:11.009234 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-1f649c86-41fe-4165-809a-45c8fa6cd6d2 tempest-VolumesSnapshotsTestJSON-1394051177 tempest-VolumesSnapshotsTestJSON-1394051177-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/0262da60-0880-4fab-a0b4-6e0bc210d624" status: 202 len: 0 microversion: 2.1 time: 0.254994 Aug 26 01:00:11.009801 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 398/797] 10.222.0.59 () {58 vars in 1248 bytes} [Fri Aug 26 01:00:10 2022] DELETE /compute/v2.1/os-volumes/0262da60-0880-4fab-a0b4-6e0bc210d624 => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 01:00:11.019167 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-cd704374-30c6-4b1d-9c27-71abdb70cf65 tempest-VolumesSnapshotsTestJSON-1394051177 tempest-VolumesSnapshotsTestJSON-1394051177-project] Calling method '.version_select at 0x7f8a931f3af0>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:11.067088 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-cd704374-30c6-4b1d-9c27-71abdb70cf65 tempest-VolumesSnapshotsTestJSON-1394051177 tempest-VolumesSnapshotsTestJSON-1394051177-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/0262da60-0880-4fab-a0b4-6e0bc210d624" status: 200 len: 344 microversion: 2.1 time: 0.052725 Aug 26 01:00:11.067658 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 400/798] 10.222.0.59 () {58 vars in 1245 bytes} [Fri Aug 26 01:00:11 2022] GET /compute/v2.1/os-volumes/0262da60-0880-4fab-a0b4-6e0bc210d624 => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:00:11.242334 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-f2759cba-b72b-4f6a-ba80-d5cad569bb06 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:11.242980 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-f2759cba-b72b-4f6a-ba80-d5cad569bb06 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:00:11.248910 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f2759cba-b72b-4f6a-ba80-d5cad569bb06 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:11.249397 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f2759cba-b72b-4f6a-ba80-d5cad569bb06 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:11.249832 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f2759cba-b72b-4f6a-ba80-d5cad569bb06 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:11.250520 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f2759cba-b72b-4f6a-ba80-d5cad569bb06 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:11.250977 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f2759cba-b72b-4f6a-ba80-d5cad569bb06 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:11.251909 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f2759cba-b72b-4f6a-ba80-d5cad569bb06 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:11.400506 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-f2759cba-b72b-4f6a-ba80-d5cad569bb06 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:11.409990 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-f2759cba-b72b-4f6a-ba80-d5cad569bb06 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:11.411430 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-f2759cba-b72b-4f6a-ba80-d5cad569bb06 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:11.412625 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-f2759cba-b72b-4f6a-ba80-d5cad569bb06 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 200 len: 1730 microversion: 2.20 time: 0.174653 Aug 26 01:00:11.413518 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 399/799] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 01:00:11 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 01:00:12.081906 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-bb733dd8-94e9-498f-a307-0e5d6a2dd9e0 tempest-VolumesSnapshotsTestJSON-1394051177 tempest-VolumesSnapshotsTestJSON-1394051177-project] Calling method '.version_select at 0x7f8a92e2dee0>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:12.108710 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.wsgi [None req-bb733dd8-94e9-498f-a307-0e5d6a2dd9e0 tempest-VolumesSnapshotsTestJSON-1394051177 tempest-VolumesSnapshotsTestJSON-1394051177-project] HTTP exception thrown: Volume 0262da60-0880-4fab-a0b4-6e0bc210d624 could not be found. Aug 26 01:00:12.110663 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-bb733dd8-94e9-498f-a307-0e5d6a2dd9e0 tempest-VolumesSnapshotsTestJSON-1394051177 tempest-VolumesSnapshotsTestJSON-1394051177-project] Request method failure captured: Aug 26 01:00:12.110663 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: request: GET /compute/v2.1/os-volumes/0262da60-0880-4fab-a0b4-6e0bc210d624 HTTP/1.1 Aug 26 01:00:12.110663 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Accept: application/json Aug 26 01:00:12.110663 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Accept-Encoding: identity Aug 26 01:00:12.110663 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Connection: close Aug 26 01:00:12.110663 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Content-Length: 0 Aug 26 01:00:12.110663 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Content-Type: application/json Aug 26 01:00:12.110663 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Host: 10.222.0.59 Aug 26 01:00:12.110663 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Openstack-System-Scope: None Aug 26 01:00:12.110663 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: User-Agent: python-urllib3/1.26.11 Aug 26 01:00:12.110663 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Auth-Token: gAAAAABjCBsSnoRVpc5VXZYAJkF8_wj6cWK9z6as48uTaLWGckWFl-o2N48t3StYURJZzj5NFle43hM808EQxWV0gWcQED1rH4HkVjM_bT4M6bp_pqBEqh1lPHjMes1owxlMpZb5pdBMIFvGdg06pyfRd4S4VklkWJI_AhG5a8JN8P_aEJbpgF8 Aug 26 01:00:12.110663 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Domain-Id: None Aug 26 01:00:12.110663 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Domain-Name: None Aug 26 01:00:12.110663 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Identity-Status: Confirmed Aug 26 01:00:12.110663 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Is-Admin-Project: True Aug 26 01:00:12.110663 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Domain-Id: default Aug 26 01:00:12.110663 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Domain-Name: Default Aug 26 01:00:12.110663 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Id: 1173abf0d8774c4090d36ae3546c961b Aug 26 01:00:12.110663 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1394051177 Aug 26 01:00:12.110663 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Role: reader,member Aug 26 01:00:12.110663 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Roles: reader,member Aug 26 01:00:12.112213 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1173abf0d8774c4090d36ae3546c961b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1173abf0d8774c4090d36ae3546c961b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1173abf0d8774c4090d36ae3546c961b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1173abf0d8774c4090d36ae3546c961b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 01:00:12.112213 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1394051177 Aug 26 01:00:12.112213 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant-Id: 1173abf0d8774c4090d36ae3546c961b Aug 26 01:00:12.112213 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1394051177 Aug 26 01:00:12.112213 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User: tempest-VolumesSnapshotsTestJSON-1394051177-project Aug 26 01:00:12.112213 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Domain-Id: default Aug 26 01:00:12.112213 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Domain-Name: Default Aug 26 01:00:12.112213 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Id: 6853ce2599fa4099940e6a5791b756d1 Aug 26 01:00:12.112213 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1394051177-project Aug 26 01:00:12.112213 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: method: Aug 26 01:00:12.112213 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: exception: Volume 0262da60-0880-4fab-a0b4-6e0bc210d624 could not be found. Aug 26 01:00:12.112213 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: action_args: {'id': '0262da60-0880-4fab-a0b4-6e0bc210d624'} Aug 26 01:00:12.112213 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 01:00:12.113142 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:00:12.113142 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 01:00:12.113142 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 01:00:12.113142 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 26 01:00:12.113142 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 26 01:00:12.113142 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 26 01:00:12.113142 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 26 01:00:12.113142 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 01:00:12.113142 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 01:00:12.113142 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 01:00:12.113142 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 01:00:12.113142 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 01:00:12.113142 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 01:00:12.113142 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 01:00:12.113142 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 01:00:12.113142 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0262da60-0880-4fab-a0b4-6e0bc210d624 could not be found. (HTTP 404) (Request-ID: req-efa0bc84-af63-4354-96ed-282ea506b68a) Aug 26 01:00:12.113142 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:00:12.113142 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:00:12.113142 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:00:12.114533 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:00:12.114533 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 26 01:00:12.114533 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 26 01:00:12.114533 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 26 01:00:12.114533 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 26 01:00:12.114533 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 26 01:00:12.114533 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 26 01:00:12.114533 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 26 01:00:12.114533 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 26 01:00:12.114533 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 01:00:12.114533 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 01:00:12.114533 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 26 01:00:12.114533 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 26 01:00:12.114533 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 26 01:00:12.114533 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 26 01:00:12.114533 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 01:00:12.114533 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 01:00:12.114533 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 01:00:12.114533 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 01:00:12.115926 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 01:00:12.115926 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 01:00:12.115926 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 01:00:12.115926 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 01:00:12.115926 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0262da60-0880-4fab-a0b4-6e0bc210d624 could not be found. Aug 26 01:00:12.115926 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:00:12.115926 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:00:12.115926 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:00:12.115926 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:00:12.115926 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:00:12.115926 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:00:12.115926 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 01:00:12.115926 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 01:00:12.115926 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 01:00:12.115926 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 01:00:12.115926 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 01:00:12.115926 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 01:00:12.115926 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 26 01:00:12.115926 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 01:00:12.117376 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0262da60-0880-4fab-a0b4-6e0bc210d624 could not be found. Aug 26 01:00:12.117376 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:00:12.117376 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:00:12.117376 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:00:12.117376 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:00:12.117376 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:00:12.117376 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:00:12.117376 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 01:00:12.117376 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 01:00:12.117376 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0262da60-0880-4fab-a0b4-6e0bc210d624 could not be found. Aug 26 01:00:12.117376 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:00:12.117376 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-bb733dd8-94e9-498f-a307-0e5d6a2dd9e0 tempest-VolumesSnapshotsTestJSON-1394051177 tempest-VolumesSnapshotsTestJSON-1394051177-project] Returning 404 to user: Volume 0262da60-0880-4fab-a0b4-6e0bc210d624 could not be found. {{(pid=127564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 01:00:12.117376 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-bb733dd8-94e9-498f-a307-0e5d6a2dd9e0 tempest-VolumesSnapshotsTestJSON-1394051177 tempest-VolumesSnapshotsTestJSON-1394051177-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/0262da60-0880-4fab-a0b4-6e0bc210d624" status: 404 len: 109 microversion: 2.1 time: 0.034732 Aug 26 01:00:12.117376 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 401/800] 10.222.0.59 () {58 vars in 1245 bytes} [Fri Aug 26 01:00:12 2022] GET /compute/v2.1/os-volumes/0262da60-0880-4fab-a0b4-6e0bc210d624 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 01:00:12.125734 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-01de116a-270e-4347-8363-b58ca1705501 tempest-VolumesSnapshotsTestJSON-1394051177 tempest-VolumesSnapshotsTestJSON-1394051177-project] Calling method '.version_select at 0x7f8a92c58ee0>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:12.153866 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.wsgi [None req-01de116a-270e-4347-8363-b58ca1705501 tempest-VolumesSnapshotsTestJSON-1394051177 tempest-VolumesSnapshotsTestJSON-1394051177-project] HTTP exception thrown: Volume 0262da60-0880-4fab-a0b4-6e0bc210d624 could not be found. Aug 26 01:00:12.155899 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-01de116a-270e-4347-8363-b58ca1705501 tempest-VolumesSnapshotsTestJSON-1394051177 tempest-VolumesSnapshotsTestJSON-1394051177-project] Request method failure captured: Aug 26 01:00:12.155899 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: request: DELETE /compute/v2.1/os-volumes/0262da60-0880-4fab-a0b4-6e0bc210d624 HTTP/1.1 Aug 26 01:00:12.155899 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Accept: application/json Aug 26 01:00:12.155899 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Accept-Encoding: identity Aug 26 01:00:12.155899 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Connection: close Aug 26 01:00:12.155899 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Content-Length: 0 Aug 26 01:00:12.155899 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Content-Type: application/json Aug 26 01:00:12.155899 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Host: 10.222.0.59 Aug 26 01:00:12.155899 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Openstack-System-Scope: None Aug 26 01:00:12.155899 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: User-Agent: python-urllib3/1.26.11 Aug 26 01:00:12.155899 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Auth-Token: gAAAAABjCBsSnoRVpc5VXZYAJkF8_wj6cWK9z6as48uTaLWGckWFl-o2N48t3StYURJZzj5NFle43hM808EQxWV0gWcQED1rH4HkVjM_bT4M6bp_pqBEqh1lPHjMes1owxlMpZb5pdBMIFvGdg06pyfRd4S4VklkWJI_AhG5a8JN8P_aEJbpgF8 Aug 26 01:00:12.155899 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Domain-Id: None Aug 26 01:00:12.155899 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Domain-Name: None Aug 26 01:00:12.155899 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Identity-Status: Confirmed Aug 26 01:00:12.155899 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Is-Admin-Project: True Aug 26 01:00:12.155899 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Domain-Id: default Aug 26 01:00:12.155899 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Domain-Name: Default Aug 26 01:00:12.155899 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Id: 1173abf0d8774c4090d36ae3546c961b Aug 26 01:00:12.155899 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1394051177 Aug 26 01:00:12.155899 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Role: reader,member Aug 26 01:00:12.155899 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Roles: reader,member Aug 26 01:00:12.157628 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1173abf0d8774c4090d36ae3546c961b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1173abf0d8774c4090d36ae3546c961b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1173abf0d8774c4090d36ae3546c961b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1173abf0d8774c4090d36ae3546c961b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 01:00:12.157628 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1394051177 Aug 26 01:00:12.157628 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant-Id: 1173abf0d8774c4090d36ae3546c961b Aug 26 01:00:12.157628 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1394051177 Aug 26 01:00:12.157628 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User: tempest-VolumesSnapshotsTestJSON-1394051177-project Aug 26 01:00:12.157628 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Domain-Id: default Aug 26 01:00:12.157628 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Domain-Name: Default Aug 26 01:00:12.157628 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Id: 6853ce2599fa4099940e6a5791b756d1 Aug 26 01:00:12.157628 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1394051177-project Aug 26 01:00:12.157628 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: method: Aug 26 01:00:12.157628 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: exception: Volume 0262da60-0880-4fab-a0b4-6e0bc210d624 could not be found. Aug 26 01:00:12.157628 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: action_args: {'id': '0262da60-0880-4fab-a0b4-6e0bc210d624'} Aug 26 01:00:12.157628 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 01:00:12.158605 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:00:12.158605 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 01:00:12.158605 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 01:00:12.158605 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 26 01:00:12.158605 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 26 01:00:12.158605 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 26 01:00:12.158605 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 26 01:00:12.158605 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 26 01:00:12.158605 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 26 01:00:12.158605 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 26 01:00:12.158605 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 26 01:00:12.158605 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 01:00:12.158605 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 01:00:12.158605 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 01:00:12.158605 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 01:00:12.158605 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0262da60-0880-4fab-a0b4-6e0bc210d624 could not be found. (HTTP 404) (Request-ID: req-0d8a57c9-b771-497c-a216-38d3a536b987) Aug 26 01:00:12.158605 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:00:12.158605 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:00:12.158605 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:00:12.160005 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:00:12.160005 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 26 01:00:12.160005 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 26 01:00:12.160005 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 26 01:00:12.160005 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 26 01:00:12.160005 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 26 01:00:12.160005 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 26 01:00:12.160005 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 26 01:00:12.160005 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 26 01:00:12.160005 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 01:00:12.160005 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 01:00:12.160005 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 26 01:00:12.160005 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 26 01:00:12.160005 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 26 01:00:12.160005 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 26 01:00:12.160005 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 26 01:00:12.160005 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 26 01:00:12.160005 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 26 01:00:12.160005 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 26 01:00:12.161651 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 01:00:12.161651 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 01:00:12.161651 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 01:00:12.161651 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 01:00:12.161651 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0262da60-0880-4fab-a0b4-6e0bc210d624 could not be found. Aug 26 01:00:12.161651 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:00:12.161651 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:00:12.161651 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:00:12.161651 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:00:12.161651 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:00:12.161651 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:00:12.161651 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 01:00:12.161651 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 01:00:12.161651 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 01:00:12.161651 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 01:00:12.161651 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 01:00:12.161651 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 01:00:12.161651 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 26 01:00:12.161651 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 01:00:12.163288 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0262da60-0880-4fab-a0b4-6e0bc210d624 could not be found. Aug 26 01:00:12.163288 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:00:12.163288 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:00:12.163288 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:00:12.163288 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:00:12.163288 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:00:12.163288 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:00:12.163288 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 01:00:12.163288 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 01:00:12.163288 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0262da60-0880-4fab-a0b4-6e0bc210d624 could not be found. Aug 26 01:00:12.163288 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:00:12.163288 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-01de116a-270e-4347-8363-b58ca1705501 tempest-VolumesSnapshotsTestJSON-1394051177 tempest-VolumesSnapshotsTestJSON-1394051177-project] Returning 404 to user: Volume 0262da60-0880-4fab-a0b4-6e0bc210d624 could not be found. {{(pid=127565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 01:00:12.163288 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-01de116a-270e-4347-8363-b58ca1705501 tempest-VolumesSnapshotsTestJSON-1394051177 tempest-VolumesSnapshotsTestJSON-1394051177-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/0262da60-0880-4fab-a0b4-6e0bc210d624" status: 404 len: 109 microversion: 2.1 time: 0.035433 Aug 26 01:00:12.163288 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 400/801] 10.222.0.59 () {58 vars in 1248 bytes} [Fri Aug 26 01:00:12 2022] DELETE /compute/v2.1/os-volumes/0262da60-0880-4fab-a0b4-6e0bc210d624 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 01:00:12.166319 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-e0e9d579-026f-4066-9f14-6e3bb5a96971 tempest-VolumesSnapshotsTestJSON-1394051177 tempest-VolumesSnapshotsTestJSON-1394051177-project] Calling method '.version_select at 0x7f8a966fa310>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:12.194141 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.wsgi [None req-e0e9d579-026f-4066-9f14-6e3bb5a96971 tempest-VolumesSnapshotsTestJSON-1394051177 tempest-VolumesSnapshotsTestJSON-1394051177-project] HTTP exception thrown: Volume 0262da60-0880-4fab-a0b4-6e0bc210d624 could not be found. Aug 26 01:00:12.196087 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-e0e9d579-026f-4066-9f14-6e3bb5a96971 tempest-VolumesSnapshotsTestJSON-1394051177 tempest-VolumesSnapshotsTestJSON-1394051177-project] Request method failure captured: Aug 26 01:00:12.196087 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: request: GET /compute/v2.1/os-volumes/0262da60-0880-4fab-a0b4-6e0bc210d624 HTTP/1.1 Aug 26 01:00:12.196087 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Accept: application/json Aug 26 01:00:12.196087 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Accept-Encoding: identity Aug 26 01:00:12.196087 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Connection: close Aug 26 01:00:12.196087 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Content-Length: 0 Aug 26 01:00:12.196087 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Content-Type: application/json Aug 26 01:00:12.196087 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Host: 10.222.0.59 Aug 26 01:00:12.196087 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Openstack-System-Scope: None Aug 26 01:00:12.196087 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: User-Agent: python-urllib3/1.26.11 Aug 26 01:00:12.196087 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Auth-Token: gAAAAABjCBsSnoRVpc5VXZYAJkF8_wj6cWK9z6as48uTaLWGckWFl-o2N48t3StYURJZzj5NFle43hM808EQxWV0gWcQED1rH4HkVjM_bT4M6bp_pqBEqh1lPHjMes1owxlMpZb5pdBMIFvGdg06pyfRd4S4VklkWJI_AhG5a8JN8P_aEJbpgF8 Aug 26 01:00:12.196087 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Domain-Id: None Aug 26 01:00:12.196087 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Domain-Name: None Aug 26 01:00:12.196087 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Identity-Status: Confirmed Aug 26 01:00:12.196087 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Is-Admin-Project: True Aug 26 01:00:12.196087 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Domain-Id: default Aug 26 01:00:12.196087 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Domain-Name: Default Aug 26 01:00:12.196087 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Id: 1173abf0d8774c4090d36ae3546c961b Aug 26 01:00:12.196087 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1394051177 Aug 26 01:00:12.196087 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Role: reader,member Aug 26 01:00:12.196087 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Roles: reader,member Aug 26 01:00:12.197852 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1173abf0d8774c4090d36ae3546c961b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1173abf0d8774c4090d36ae3546c961b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1173abf0d8774c4090d36ae3546c961b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1173abf0d8774c4090d36ae3546c961b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 01:00:12.197852 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1394051177 Aug 26 01:00:12.197852 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant-Id: 1173abf0d8774c4090d36ae3546c961b Aug 26 01:00:12.197852 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1394051177 Aug 26 01:00:12.197852 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User: tempest-VolumesSnapshotsTestJSON-1394051177-project Aug 26 01:00:12.197852 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Domain-Id: default Aug 26 01:00:12.197852 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Domain-Name: Default Aug 26 01:00:12.197852 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Id: 6853ce2599fa4099940e6a5791b756d1 Aug 26 01:00:12.197852 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1394051177-project Aug 26 01:00:12.197852 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: method: Aug 26 01:00:12.197852 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: exception: Volume 0262da60-0880-4fab-a0b4-6e0bc210d624 could not be found. Aug 26 01:00:12.197852 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: action_args: {'id': '0262da60-0880-4fab-a0b4-6e0bc210d624'} Aug 26 01:00:12.197852 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 01:00:12.199025 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:00:12.199025 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 01:00:12.199025 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 01:00:12.199025 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 26 01:00:12.199025 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 26 01:00:12.199025 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 26 01:00:12.199025 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 26 01:00:12.199025 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 01:00:12.199025 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 01:00:12.199025 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 01:00:12.199025 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 01:00:12.199025 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 01:00:12.199025 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 01:00:12.199025 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 01:00:12.199025 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 01:00:12.199025 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0262da60-0880-4fab-a0b4-6e0bc210d624 could not be found. (HTTP 404) (Request-ID: req-cd881faa-5e65-49da-b0bb-182675527c27) Aug 26 01:00:12.199025 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:00:12.199025 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:00:12.199025 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:00:12.200643 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:00:12.200643 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 26 01:00:12.200643 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 26 01:00:12.200643 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 26 01:00:12.200643 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 26 01:00:12.200643 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 26 01:00:12.200643 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 26 01:00:12.200643 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 26 01:00:12.200643 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 26 01:00:12.200643 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 01:00:12.200643 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 01:00:12.200643 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 26 01:00:12.200643 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 26 01:00:12.200643 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 26 01:00:12.200643 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 26 01:00:12.200643 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 01:00:12.200643 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 01:00:12.200643 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 01:00:12.200643 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 01:00:12.202266 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 01:00:12.202266 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 01:00:12.202266 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 01:00:12.202266 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 01:00:12.202266 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0262da60-0880-4fab-a0b4-6e0bc210d624 could not be found. Aug 26 01:00:12.202266 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:00:12.202266 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:00:12.202266 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:00:12.202266 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:00:12.202266 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:00:12.202266 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:00:12.202266 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 01:00:12.202266 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 01:00:12.202266 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 01:00:12.202266 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 01:00:12.202266 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 01:00:12.202266 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 01:00:12.202266 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 26 01:00:12.202266 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 01:00:12.204778 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0262da60-0880-4fab-a0b4-6e0bc210d624 could not be found. Aug 26 01:00:12.204778 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:00:12.204778 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:00:12.204778 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:00:12.204778 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:00:12.204778 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:00:12.204778 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:00:12.204778 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 01:00:12.204778 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 01:00:12.204778 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0262da60-0880-4fab-a0b4-6e0bc210d624 could not be found. Aug 26 01:00:12.204778 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:00:12.204778 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-e0e9d579-026f-4066-9f14-6e3bb5a96971 tempest-VolumesSnapshotsTestJSON-1394051177 tempest-VolumesSnapshotsTestJSON-1394051177-project] Returning 404 to user: Volume 0262da60-0880-4fab-a0b4-6e0bc210d624 could not be found. {{(pid=127564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 01:00:12.204778 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-e0e9d579-026f-4066-9f14-6e3bb5a96971 tempest-VolumesSnapshotsTestJSON-1394051177 tempest-VolumesSnapshotsTestJSON-1394051177-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/0262da60-0880-4fab-a0b4-6e0bc210d624" status: 404 len: 109 microversion: 2.1 time: 0.035525 Aug 26 01:00:12.204778 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 402/802] 10.222.0.59 () {58 vars in 1245 bytes} [Fri Aug 26 01:00:12 2022] GET /compute/v2.1/os-volumes/0262da60-0880-4fab-a0b4-6e0bc210d624 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 01:00:12.435941 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-4156a3f7-964a-49c1-ba41-d6df5cec776c tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:12.436729 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-4156a3f7-964a-49c1-ba41-d6df5cec776c tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:00:12.444615 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4156a3f7-964a-49c1-ba41-d6df5cec776c tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:12.445181 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4156a3f7-964a-49c1-ba41-d6df5cec776c tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:12.445676 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4156a3f7-964a-49c1-ba41-d6df5cec776c tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:12.446423 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4156a3f7-964a-49c1-ba41-d6df5cec776c tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:12.447023 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4156a3f7-964a-49c1-ba41-d6df5cec776c tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:12.447465 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4156a3f7-964a-49c1-ba41-d6df5cec776c tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:12.588744 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-4156a3f7-964a-49c1-ba41-d6df5cec776c tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:12.605195 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-4156a3f7-964a-49c1-ba41-d6df5cec776c tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:12.606628 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-4156a3f7-964a-49c1-ba41-d6df5cec776c tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:12.607785 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-4156a3f7-964a-49c1-ba41-d6df5cec776c tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 200 len: 1730 microversion: 2.20 time: 0.176545 Aug 26 01:00:12.608336 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 401/803] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 01:00:12 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 01:00:13.630918 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-f920acb6-f764-4f81-a852-72deec87116b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:13.631676 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-f920acb6-f764-4f81-a852-72deec87116b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:00:13.637924 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f920acb6-f764-4f81-a852-72deec87116b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:13.638408 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f920acb6-f764-4f81-a852-72deec87116b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:13.638845 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f920acb6-f764-4f81-a852-72deec87116b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:13.639534 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f920acb6-f764-4f81-a852-72deec87116b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:13.639990 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f920acb6-f764-4f81-a852-72deec87116b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:13.640420 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f920acb6-f764-4f81-a852-72deec87116b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:13.779205 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-f920acb6-f764-4f81-a852-72deec87116b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:13.787321 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-f920acb6-f764-4f81-a852-72deec87116b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:13.789551 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-f920acb6-f764-4f81-a852-72deec87116b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:13.790463 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-f920acb6-f764-4f81-a852-72deec87116b tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 200 len: 1730 microversion: 2.20 time: 0.163409 Aug 26 01:00:13.791024 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 403/804] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 01:00:13 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 01:00:14.505151 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [req-edc2db9f-c558-4017-ae5c-59ad0369d00a req-e1236b58-e79f-4ddc-b883-fb5d0fb163c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8af18a63-5c10-4530-9072-6ca92223b8ec", "name": "network-vif-plugged", "status": "completed", "tag": "abc8d4e4-fe47-4480-9cbb-c4ca4d73b355"}]} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:00:14.516255 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-edc2db9f-c558-4017-ae5c-59ad0369d00a req-e1236b58-e79f-4ddc-b883-fb5d0fb163c8 service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:14.517408 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-edc2db9f-c558-4017-ae5c-59ad0369d00a req-e1236b58-e79f-4ddc-b883-fb5d0fb163c8 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:14.517950 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-edc2db9f-c558-4017-ae5c-59ad0369d00a req-e1236b58-e79f-4ddc-b883-fb5d0fb163c8 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:14.529277 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.compute.server_external_events [req-edc2db9f-c558-4017-ae5c-59ad0369d00a req-e1236b58-e79f-4ddc-b883-fb5d0fb163c8 service nova] Creating event network-vif-plugged:abc8d4e4-fe47-4480-9cbb-c4ca4d73b355 for instance 8af18a63-5c10-4530-9072-6ca92223b8ec on hv-cinder-83538 Aug 26 01:00:14.534361 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [req-edc2db9f-c558-4017-ae5c-59ad0369d00a req-e1236b58-e79f-4ddc-b883-fb5d0fb163c8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035116 Aug 26 01:00:14.534939 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 402/805] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 01:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:00:14.815128 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-1fc29c07-8039-4691-9a23-2e0561f60db5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:14.815541 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-1fc29c07-8039-4691-9a23-2e0561f60db5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:00:14.822075 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1fc29c07-8039-4691-9a23-2e0561f60db5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:14.822547 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1fc29c07-8039-4691-9a23-2e0561f60db5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:14.822972 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1fc29c07-8039-4691-9a23-2e0561f60db5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:14.823654 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1fc29c07-8039-4691-9a23-2e0561f60db5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:14.824218 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1fc29c07-8039-4691-9a23-2e0561f60db5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:14.824879 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1fc29c07-8039-4691-9a23-2e0561f60db5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:15.033587 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-1fc29c07-8039-4691-9a23-2e0561f60db5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:15.042905 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-1fc29c07-8039-4691-9a23-2e0561f60db5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:15.044336 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-1fc29c07-8039-4691-9a23-2e0561f60db5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:15.045518 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-1fc29c07-8039-4691-9a23-2e0561f60db5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 200 len: 1730 microversion: 2.20 time: 0.235635 Aug 26 01:00:15.046064 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 404/806] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 01:00:14 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 1730 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 01:00:16.072049 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-7e8a8567-27f6-46fa-b3e6-9146bd522534 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:16.072763 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-7e8a8567-27f6-46fa-b3e6-9146bd522534 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:00:16.078786 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7e8a8567-27f6-46fa-b3e6-9146bd522534 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:16.079257 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7e8a8567-27f6-46fa-b3e6-9146bd522534 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:16.079686 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7e8a8567-27f6-46fa-b3e6-9146bd522534 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:16.080357 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7e8a8567-27f6-46fa-b3e6-9146bd522534 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:16.080865 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7e8a8567-27f6-46fa-b3e6-9146bd522534 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:16.081283 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7e8a8567-27f6-46fa-b3e6-9146bd522534 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:16.213600 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-7e8a8567-27f6-46fa-b3e6-9146bd522534 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:16.222312 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-7e8a8567-27f6-46fa-b3e6-9146bd522534 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:16.223780 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-7e8a8567-27f6-46fa-b3e6-9146bd522534 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:16.224998 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-7e8a8567-27f6-46fa-b3e6-9146bd522534 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 200 len: 1730 microversion: 2.20 time: 0.157696 Aug 26 01:00:16.225551 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 403/807] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 01:00:16 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 01:00:17.247407 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-c7e9cf23-e9f0-4778-b9b8-0a1018fc2cab tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:17.248057 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-c7e9cf23-e9f0-4778-b9b8-0a1018fc2cab tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:00:17.254746 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c7e9cf23-e9f0-4778-b9b8-0a1018fc2cab tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:17.255232 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c7e9cf23-e9f0-4778-b9b8-0a1018fc2cab tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:17.255672 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c7e9cf23-e9f0-4778-b9b8-0a1018fc2cab tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:17.256362 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c7e9cf23-e9f0-4778-b9b8-0a1018fc2cab tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:17.256880 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c7e9cf23-e9f0-4778-b9b8-0a1018fc2cab tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:17.257418 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c7e9cf23-e9f0-4778-b9b8-0a1018fc2cab tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:17.393029 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-c7e9cf23-e9f0-4778-b9b8-0a1018fc2cab tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:17.401195 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-c7e9cf23-e9f0-4778-b9b8-0a1018fc2cab tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:17.402649 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-c7e9cf23-e9f0-4778-b9b8-0a1018fc2cab tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:17.403831 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-c7e9cf23-e9f0-4778-b9b8-0a1018fc2cab tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 200 len: 1730 microversion: 2.20 time: 0.160447 Aug 26 01:00:17.404393 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 405/808] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 01:00:17 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 01:00:18.427343 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-914c218b-5811-4163-a4e2-826319aadde7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:18.427949 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-914c218b-5811-4163-a4e2-826319aadde7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:00:18.434487 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-914c218b-5811-4163-a4e2-826319aadde7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:18.435216 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-914c218b-5811-4163-a4e2-826319aadde7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:18.435822 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-914c218b-5811-4163-a4e2-826319aadde7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:18.436572 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-914c218b-5811-4163-a4e2-826319aadde7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:18.437020 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-914c218b-5811-4163-a4e2-826319aadde7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:18.441660 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-914c218b-5811-4163-a4e2-826319aadde7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:18.567982 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-914c218b-5811-4163-a4e2-826319aadde7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:18.576071 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-914c218b-5811-4163-a4e2-826319aadde7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:18.577545 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-914c218b-5811-4163-a4e2-826319aadde7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:18.578834 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-914c218b-5811-4163-a4e2-826319aadde7 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 200 len: 1717 microversion: 2.20 time: 0.155866 Aug 26 01:00:18.579888 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 404/809] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 01:00:18 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 1717 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 01:00:18.832609 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-19ffecbd-58ac-4b5e-adef-3578479132b6 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:18.834909 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-19ffecbd-58ac-4b5e-adef-3578479132b6 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 33bd7c7e-1f1c-4d78-9a79-142e4f5c3478] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:00:18.841258 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-19ffecbd-58ac-4b5e-adef-3578479132b6 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:18.841945 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-19ffecbd-58ac-4b5e-adef-3578479132b6 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:18.842389 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-19ffecbd-58ac-4b5e-adef-3578479132b6 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:18.843086 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-19ffecbd-58ac-4b5e-adef-3578479132b6 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:18.843538 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-19ffecbd-58ac-4b5e-adef-3578479132b6 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:18.843964 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-19ffecbd-58ac-4b5e-adef-3578479132b6 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:18.875061 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-19ffecbd-58ac-4b5e-adef-3578479132b6 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046979 Aug 26 01:00:18.875626 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 406/810] 10.222.0.59 () {58 vars in 1302 bytes} [Fri Aug 26 01:00:18 2022] GET /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:00:18.892759 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-d16d0a9c-83af-4b49-8ebb-a4f1d70ff5df tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:18.893249 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-d16d0a9c-83af-4b49-8ebb-a4f1d70ff5df tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 33bd7c7e-1f1c-4d78-9a79-142e4f5c3478] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:00:18.899091 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d16d0a9c-83af-4b49-8ebb-a4f1d70ff5df tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:18.899572 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d16d0a9c-83af-4b49-8ebb-a4f1d70ff5df tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:18.899998 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d16d0a9c-83af-4b49-8ebb-a4f1d70ff5df tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:18.900883 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d16d0a9c-83af-4b49-8ebb-a4f1d70ff5df tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:18.901330 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d16d0a9c-83af-4b49-8ebb-a4f1d70ff5df tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:18.901914 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d16d0a9c-83af-4b49-8ebb-a4f1d70ff5df tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:18.931751 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-d16d0a9c-83af-4b49-8ebb-a4f1d70ff5df tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478/os-volume_attachments/f16bc71b-4c1b-4653-8fcd-52c6d555fd59" status: 200 len: 194 microversion: 2.1 time: 0.043360 Aug 26 01:00:18.932412 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 405/811] 10.222.0.59 () {58 vars in 1413 bytes} [Fri Aug 26 01:00:18 2022] GET /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478/os-volume_attachments/f16bc71b-4c1b-4653-8fcd-52c6d555fd59 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 01:00:20.626069 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-9764de4c-b8ad-42e4-919e-a8ba941c9fc6 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "99e8bcdb-b7e8-4295-9b95-98923ef3f3de"}} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:00:20.628393 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-9764de4c-b8ad-42e4-919e-a8ba941c9fc6 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 33bd7c7e-1f1c-4d78-9a79-142e4f5c3478] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:00:20.634530 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9764de4c-b8ad-42e4-919e-a8ba941c9fc6 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:20.635015 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9764de4c-b8ad-42e4-919e-a8ba941c9fc6 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:20.635532 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9764de4c-b8ad-42e4-919e-a8ba941c9fc6 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:20.636142 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9764de4c-b8ad-42e4-919e-a8ba941c9fc6 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:20.636638 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9764de4c-b8ad-42e4-919e-a8ba941c9fc6 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:20.637068 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9764de4c-b8ad-42e4-919e-a8ba941c9fc6 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:21.407250 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-9764de4c-b8ad-42e4-919e-a8ba941c9fc6 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "POST /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.784885 Aug 26 01:00:21.407928 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 407/812] 10.222.0.59 () {60 vars in 1323 bytes} [Fri Aug 26 01:00:20 2022] POST /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478/os-volume_attachments => generated 194 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:00:29.978737 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-0c4b2aee-1ae6-487a-91fa-b08d9eabbf22 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:29.980903 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-0c4b2aee-1ae6-487a-91fa-b08d9eabbf22 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 33bd7c7e-1f1c-4d78-9a79-142e4f5c3478] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:00:29.983634 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:00:29.984314 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:00:29.989110 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0c4b2aee-1ae6-487a-91fa-b08d9eabbf22 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:29.989683 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0c4b2aee-1ae6-487a-91fa-b08d9eabbf22 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:29.990122 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0c4b2aee-1ae6-487a-91fa-b08d9eabbf22 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:29.990805 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0c4b2aee-1ae6-487a-91fa-b08d9eabbf22 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:29.991253 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0c4b2aee-1ae6-487a-91fa-b08d9eabbf22 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:29.991675 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0c4b2aee-1ae6-487a-91fa-b08d9eabbf22 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:30.023715 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-0c4b2aee-1ae6-487a-91fa-b08d9eabbf22 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048701 Aug 26 01:00:30.024191 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 406/813] 10.222.0.59 () {58 vars in 1302 bytes} [Fri Aug 26 01:00:29 2022] GET /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:00:30.173061 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-1e519b98-bf10-498a-b98b-792288f1f7f9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:30.173634 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-1e519b98-bf10-498a-b98b-792288f1f7f9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 33bd7c7e-1f1c-4d78-9a79-142e4f5c3478] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:00:30.179714 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1e519b98-bf10-498a-b98b-792288f1f7f9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:30.180191 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1e519b98-bf10-498a-b98b-792288f1f7f9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:30.180713 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1e519b98-bf10-498a-b98b-792288f1f7f9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:30.181435 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1e519b98-bf10-498a-b98b-792288f1f7f9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:30.181886 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1e519b98-bf10-498a-b98b-792288f1f7f9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:30.182306 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1e519b98-bf10-498a-b98b-792288f1f7f9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:30.212725 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-1e519b98-bf10-498a-b98b-792288f1f7f9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478/os-volume_attachments/f16bc71b-4c1b-4653-8fcd-52c6d555fd59" status: 200 len: 194 microversion: 2.1 time: 0.044649 Aug 26 01:00:30.213317 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 408/814] 10.222.0.59 () {58 vars in 1413 bytes} [Fri Aug 26 01:00:30 2022] GET /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478/os-volume_attachments/f16bc71b-4c1b-4653-8fcd-52c6d555fd59 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:00:30.231164 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-1433c48f-af4c-43a3-bd34-f0d057071faa tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:30.231655 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-1433c48f-af4c-43a3-bd34-f0d057071faa tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 33bd7c7e-1f1c-4d78-9a79-142e4f5c3478] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:00:30.238629 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1433c48f-af4c-43a3-bd34-f0d057071faa tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:30.239115 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1433c48f-af4c-43a3-bd34-f0d057071faa tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:30.239561 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1433c48f-af4c-43a3-bd34-f0d057071faa tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:30.240247 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1433c48f-af4c-43a3-bd34-f0d057071faa tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:30.240733 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1433c48f-af4c-43a3-bd34-f0d057071faa tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:30.241162 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1433c48f-af4c-43a3-bd34-f0d057071faa tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:30.322815 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.objects.instance [None req-1433c48f-af4c-43a3-bd34-f0d057071faa tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lazy-loading 'services' on Instance uuid 33bd7c7e-1f1c-4d78-9a79-142e4f5c3478 {{(pid=127565) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 01:00:30.539933 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-1433c48f-af4c-43a3-bd34-f0d057071faa tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "DELETE /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478/os-volume_attachments/f16bc71b-4c1b-4653-8fcd-52c6d555fd59" status: 202 len: 0 microversion: 2.1 time: 0.312502 Aug 26 01:00:30.540544 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 407/815] 10.222.0.59 () {58 vars in 1416 bytes} [Fri Aug 26 01:00:30 2022] DELETE /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478/os-volume_attachments/f16bc71b-4c1b-4653-8fcd-52c6d555fd59 => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 01:00:32.718638 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-6b960f54-eead-496d-bea8-318e01cf47eb tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:32.719242 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-6b960f54-eead-496d-bea8-318e01cf47eb tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 33bd7c7e-1f1c-4d78-9a79-142e4f5c3478] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:00:32.721776 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_api:SELECT=20 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:00:32.726620 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6b960f54-eead-496d-bea8-318e01cf47eb tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:32.727102 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6b960f54-eead-496d-bea8-318e01cf47eb tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:32.727534 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6b960f54-eead-496d-bea8-318e01cf47eb tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:32.728220 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6b960f54-eead-496d-bea8-318e01cf47eb tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:32.728701 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6b960f54-eead-496d-bea8-318e01cf47eb tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:32.729128 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6b960f54-eead-496d-bea8-318e01cf47eb tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:32.757830 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-6b960f54-eead-496d-bea8-318e01cf47eb tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478/os-volume_attachments/99e8bcdb-b7e8-4295-9b95-98923ef3f3de" status: 200 len: 194 microversion: 2.1 time: 0.043212 Aug 26 01:00:32.758396 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 409/816] 10.222.0.59 () {58 vars in 1413 bytes} [Fri Aug 26 01:00:32 2022] GET /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478/os-volume_attachments/99e8bcdb-b7e8-4295-9b95-98923ef3f3de => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:00:32.770720 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-7e2ecb46-e8eb-40fd-8940-20bcbd6593ac tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:32.771328 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-7e2ecb46-e8eb-40fd-8940-20bcbd6593ac tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 33bd7c7e-1f1c-4d78-9a79-142e4f5c3478] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:00:32.777686 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7e2ecb46-e8eb-40fd-8940-20bcbd6593ac tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:32.778167 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7e2ecb46-e8eb-40fd-8940-20bcbd6593ac tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:32.778604 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7e2ecb46-e8eb-40fd-8940-20bcbd6593ac tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:32.785041 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7e2ecb46-e8eb-40fd-8940-20bcbd6593ac tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:32.785041 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7e2ecb46-e8eb-40fd-8940-20bcbd6593ac tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:32.785041 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7e2ecb46-e8eb-40fd-8940-20bcbd6593ac tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:32.864002 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.objects.instance [None req-7e2ecb46-e8eb-40fd-8940-20bcbd6593ac tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lazy-loading 'services' on Instance uuid 33bd7c7e-1f1c-4d78-9a79-142e4f5c3478 {{(pid=127565) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 01:00:33.128404 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-7e2ecb46-e8eb-40fd-8940-20bcbd6593ac tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "DELETE /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478/os-volume_attachments/99e8bcdb-b7e8-4295-9b95-98923ef3f3de" status: 202 len: 0 microversion: 2.1 time: 0.362353 Aug 26 01:00:33.129299 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 408/817] 10.222.0.59 () {58 vars in 1416 bytes} [Fri Aug 26 01:00:32 2022] DELETE /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478/os-volume_attachments/99e8bcdb-b7e8-4295-9b95-98923ef3f3de => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 01:00:35.351139 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-11b5f039-a9af-4f9d-b8c0-a383eb19627e tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:35.353578 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-11b5f039-a9af-4f9d-b8c0-a383eb19627e tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 33bd7c7e-1f1c-4d78-9a79-142e4f5c3478] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:00:35.359930 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-11b5f039-a9af-4f9d-b8c0-a383eb19627e tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:35.360423 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-11b5f039-a9af-4f9d-b8c0-a383eb19627e tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:35.368182 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-11b5f039-a9af-4f9d-b8c0-a383eb19627e tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:35.368182 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-11b5f039-a9af-4f9d-b8c0-a383eb19627e tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:35.368182 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-11b5f039-a9af-4f9d-b8c0-a383eb19627e tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:35.368182 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-11b5f039-a9af-4f9d-b8c0-a383eb19627e tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:35.368585 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:00:35.391541 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-11b5f039-a9af-4f9d-b8c0-a383eb19627e tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045201 Aug 26 01:00:35.392104 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 410/818] 10.222.0.59 () {58 vars in 1302 bytes} [Fri Aug 26 01:00:35 2022] GET /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 01:00:35.505635 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-c8bd6273-5a76-4135-8591-5955aad02259 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:35.507948 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-c8bd6273-5a76-4135-8591-5955aad02259 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 33bd7c7e-1f1c-4d78-9a79-142e4f5c3478] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:00:35.514467 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c8bd6273-5a76-4135-8591-5955aad02259 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:35.514933 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c8bd6273-5a76-4135-8591-5955aad02259 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:35.515370 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c8bd6273-5a76-4135-8591-5955aad02259 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:35.516050 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c8bd6273-5a76-4135-8591-5955aad02259 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:35.516527 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c8bd6273-5a76-4135-8591-5955aad02259 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:35.516954 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c8bd6273-5a76-4135-8591-5955aad02259 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:35.548268 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-c8bd6273-5a76-4135-8591-5955aad02259 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047320 Aug 26 01:00:35.548852 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 409/819] 10.222.0.59 () {58 vars in 1302 bytes} [Fri Aug 26 01:00:35 2022] GET /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 01:00:35.617347 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-5372b679-a40c-495a-a67b-516d3021daeb tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:35.617347 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-5372b679-a40c-495a-a67b-516d3021daeb tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 33bd7c7e-1f1c-4d78-9a79-142e4f5c3478] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:00:35.621853 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5372b679-a40c-495a-a67b-516d3021daeb tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:35.622328 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5372b679-a40c-495a-a67b-516d3021daeb tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:35.622758 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5372b679-a40c-495a-a67b-516d3021daeb tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:35.623534 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5372b679-a40c-495a-a67b-516d3021daeb tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:35.623974 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5372b679-a40c-495a-a67b-516d3021daeb tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:35.624390 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5372b679-a40c-495a-a67b-516d3021daeb tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:35.649882 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-5372b679-a40c-495a-a67b-516d3021daeb tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 33bd7c7e-1f1c-4d78-9a79-142e4f5c3478] Going to try to terminate instance {{(pid=127564) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 01:00:35.901938 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-5372b679-a40c-495a-a67b-516d3021daeb tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "DELETE /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478" status: 204 len: 0 microversion: 2.1 time: 0.291644 Aug 26 01:00:35.902757 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 411/820] 10.222.0.59 () {58 vars in 1239 bytes} [Fri Aug 26 01:00:35 2022] DELETE /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 01:00:35.911286 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-5fbcfcd4-cc80-4ab4-ba59-7c280ca9e479 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:35.911900 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-5fbcfcd4-cc80-4ab4-ba59-7c280ca9e479 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 33bd7c7e-1f1c-4d78-9a79-142e4f5c3478] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:00:35.918336 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5fbcfcd4-cc80-4ab4-ba59-7c280ca9e479 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:35.918818 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5fbcfcd4-cc80-4ab4-ba59-7c280ca9e479 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:35.923324 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5fbcfcd4-cc80-4ab4-ba59-7c280ca9e479 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:35.924091 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5fbcfcd4-cc80-4ab4-ba59-7c280ca9e479 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:35.924526 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5fbcfcd4-cc80-4ab4-ba59-7c280ca9e479 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:35.924990 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5fbcfcd4-cc80-4ab4-ba59-7c280ca9e479 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:36.062465 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-5fbcfcd4-cc80-4ab4-ba59-7c280ca9e479 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:36.070308 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-5fbcfcd4-cc80-4ab4-ba59-7c280ca9e479 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478" status: 200 len: 1673 microversion: 2.1 time: 0.163432 Aug 26 01:00:36.070882 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 410/821] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:00:35 2022] GET /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478 => generated 1673 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:00:37.091582 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-8a6f0431-36fb-43b5-afb0-2a2e50a4b1ac tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:37.092285 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-8a6f0431-36fb-43b5-afb0-2a2e50a4b1ac tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 33bd7c7e-1f1c-4d78-9a79-142e4f5c3478] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:00:37.099306 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8a6f0431-36fb-43b5-afb0-2a2e50a4b1ac tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:37.099794 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8a6f0431-36fb-43b5-afb0-2a2e50a4b1ac tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:37.100234 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8a6f0431-36fb-43b5-afb0-2a2e50a4b1ac tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:37.100958 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8a6f0431-36fb-43b5-afb0-2a2e50a4b1ac tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:37.101412 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8a6f0431-36fb-43b5-afb0-2a2e50a4b1ac tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:37.101842 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8a6f0431-36fb-43b5-afb0-2a2e50a4b1ac tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:37.233480 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-8a6f0431-36fb-43b5-afb0-2a2e50a4b1ac tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:37.241776 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-8a6f0431-36fb-43b5-afb0-2a2e50a4b1ac tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478" status: 200 len: 1673 microversion: 2.1 time: 0.154332 Aug 26 01:00:37.242345 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 412/822] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:00:37 2022] GET /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478 => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:00:38.262593 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-b248ff0f-0a82-4fb1-bd15-542d384755b9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:38.263231 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-b248ff0f-0a82-4fb1-bd15-542d384755b9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 33bd7c7e-1f1c-4d78-9a79-142e4f5c3478] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:00:38.286119 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b248ff0f-0a82-4fb1-bd15-542d384755b9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:38.286119 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b248ff0f-0a82-4fb1-bd15-542d384755b9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:38.286119 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b248ff0f-0a82-4fb1-bd15-542d384755b9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:38.286119 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b248ff0f-0a82-4fb1-bd15-542d384755b9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:38.286508 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b248ff0f-0a82-4fb1-bd15-542d384755b9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:38.286508 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b248ff0f-0a82-4fb1-bd15-542d384755b9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:38.422323 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-b248ff0f-0a82-4fb1-bd15-542d384755b9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:38.430155 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-b248ff0f-0a82-4fb1-bd15-542d384755b9 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478" status: 200 len: 1673 microversion: 2.1 time: 0.171713 Aug 26 01:00:38.430722 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 411/823] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:00:38 2022] GET /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478 => generated 1673 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:00:39.012855 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [req-af8c09f2-56f3-40f7-8cdc-60fd36cf63e1 req-6e86d060-411c-4ef2-83d0-d1f3f1e7508a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33bd7c7e-1f1c-4d78-9a79-142e4f5c3478", "name": "network-vif-deleted", "tag": "f8e66d90-cfee-41e2-bd68-668434bd3c87"}]} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:00:39.026043 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-af8c09f2-56f3-40f7-8cdc-60fd36cf63e1 req-6e86d060-411c-4ef2-83d0-d1f3f1e7508a service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:39.026546 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-af8c09f2-56f3-40f7-8cdc-60fd36cf63e1 req-6e86d060-411c-4ef2-83d0-d1f3f1e7508a service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:39.026975 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-af8c09f2-56f3-40f7-8cdc-60fd36cf63e1 req-6e86d060-411c-4ef2-83d0-d1f3f1e7508a service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:39.044392 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.compute.server_external_events [req-af8c09f2-56f3-40f7-8cdc-60fd36cf63e1 req-6e86d060-411c-4ef2-83d0-d1f3f1e7508a service nova] Creating event network-vif-deleted:f8e66d90-cfee-41e2-bd68-668434bd3c87 for instance 33bd7c7e-1f1c-4d78-9a79-142e4f5c3478 on hv-cinder-83538 Aug 26 01:00:39.052109 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [req-af8c09f2-56f3-40f7-8cdc-60fd36cf63e1 req-6e86d060-411c-4ef2-83d0-d1f3f1e7508a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043937 Aug 26 01:00:39.058076 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 413/824] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 01:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:00:39.451239 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-893a26b0-9cf1-45ad-ac31-462561fa215a tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:39.451844 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-893a26b0-9cf1-45ad-ac31-462561fa215a tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 33bd7c7e-1f1c-4d78-9a79-142e4f5c3478] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:00:39.458223 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-893a26b0-9cf1-45ad-ac31-462561fa215a tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:39.461016 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-893a26b0-9cf1-45ad-ac31-462561fa215a tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:39.461016 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-893a26b0-9cf1-45ad-ac31-462561fa215a tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:39.461016 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-893a26b0-9cf1-45ad-ac31-462561fa215a tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:39.461016 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-893a26b0-9cf1-45ad-ac31-462561fa215a tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:39.461410 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-893a26b0-9cf1-45ad-ac31-462561fa215a tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:39.493297 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-893a26b0-9cf1-45ad-ac31-462561fa215a tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:39.493838 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-893a26b0-9cf1-45ad-ac31-462561fa215a tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:39.494250 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-893a26b0-9cf1-45ad-ac31-462561fa215a tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:39.494692 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.objects.instance [None req-893a26b0-9cf1-45ad-ac31-462561fa215a tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lazy-loading 'fault' on Instance uuid 33bd7c7e-1f1c-4d78-9a79-142e4f5c3478 {{(pid=127565) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 01:00:39.537103 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-893a26b0-9cf1-45ad-ac31-462561fa215a tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0175a2b440704d51aa14607a2e20e36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5219060f4c184521919b017e8435eca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:39.546630 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-893a26b0-9cf1-45ad-ac31-462561fa215a tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478" status: 200 len: 1325 microversion: 2.1 time: 0.099081 Aug 26 01:00:39.547500 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 412/825] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:00:39 2022] GET /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478 => generated 1325 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:00:40.572354 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-49cbccd2-c171-4b07-8400-d8472d0146da tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:40.572354 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-49cbccd2-c171-4b07-8400-d8472d0146da tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 33bd7c7e-1f1c-4d78-9a79-142e4f5c3478] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:00:40.578064 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-49cbccd2-c171-4b07-8400-d8472d0146da tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:40.578546 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-49cbccd2-c171-4b07-8400-d8472d0146da tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:40.578982 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-49cbccd2-c171-4b07-8400-d8472d0146da tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:40.579685 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-49cbccd2-c171-4b07-8400-d8472d0146da tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:40.580139 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-49cbccd2-c171-4b07-8400-d8472d0146da tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:40.581107 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-49cbccd2-c171-4b07-8400-d8472d0146da tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:40.594433 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.wsgi [None req-49cbccd2-c171-4b07-8400-d8472d0146da tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] HTTP exception thrown: Instance 33bd7c7e-1f1c-4d78-9a79-142e4f5c3478 could not be found. Aug 26 01:00:40.596045 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-49cbccd2-c171-4b07-8400-d8472d0146da tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Request method failure captured: Aug 26 01:00:40.596045 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: request: GET /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478 HTTP/1.1 Aug 26 01:00:40.596045 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Accept: application/json Aug 26 01:00:40.596045 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Accept-Encoding: identity Aug 26 01:00:40.596045 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Connection: close Aug 26 01:00:40.596045 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Content-Length: 0 Aug 26 01:00:40.596045 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Content-Type: application/json Aug 26 01:00:40.596045 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Host: 10.222.0.59 Aug 26 01:00:40.596045 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Openstack-System-Scope: None Aug 26 01:00:40.596045 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: User-Agent: python-urllib3/1.26.11 Aug 26 01:00:40.596045 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Auth-Token: gAAAAABjCBmiJo3kHvT10T9Jjy1jBOSn7Bvzod408w2BCSd4FzzPtblMjSj90SuE4WhMVZE2OrkiKwE92EB5k_lvN938POeSncFplvwObTb9e_H71QzgJINEFj-VDMGTlVcWf_-YnYu6U7ZMq5okhfSfjxKfk0TZV25UNGIJCVy-wTX5xriWOMY Aug 26 01:00:40.596045 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Domain-Id: None Aug 26 01:00:40.596045 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Domain-Name: None Aug 26 01:00:40.596045 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Identity-Status: Confirmed Aug 26 01:00:40.596045 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Is-Admin-Project: True Aug 26 01:00:40.596045 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Domain-Id: default Aug 26 01:00:40.596045 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Domain-Name: Default Aug 26 01:00:40.596045 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Id: 5219060f4c184521919b017e8435eca5 Aug 26 01:00:40.596045 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Name: tempest-AttachVolumeTestJSON-921770591 Aug 26 01:00:40.596045 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Role: reader,member Aug 26 01:00:40.596045 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Roles: reader,member Aug 26 01:00:40.603321 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5219060f4c184521919b017e8435eca5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5219060f4c184521919b017e8435eca5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5219060f4c184521919b017e8435eca5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5219060f4c184521919b017e8435eca5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 01:00:40.603321 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant: tempest-AttachVolumeTestJSON-921770591 Aug 26 01:00:40.603321 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant-Id: 5219060f4c184521919b017e8435eca5 Aug 26 01:00:40.603321 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant-Name: tempest-AttachVolumeTestJSON-921770591 Aug 26 01:00:40.603321 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User: tempest-AttachVolumeTestJSON-921770591-project Aug 26 01:00:40.603321 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Domain-Id: default Aug 26 01:00:40.603321 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Domain-Name: Default Aug 26 01:00:40.603321 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Id: 0175a2b440704d51aa14607a2e20e36a Aug 26 01:00:40.603321 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Name: tempest-AttachVolumeTestJSON-921770591-project Aug 26 01:00:40.603321 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: method: > Aug 26 01:00:40.603321 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: exception: Instance 33bd7c7e-1f1c-4d78-9a79-142e4f5c3478 could not be found. Aug 26 01:00:40.603321 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: action_args: {'id': '33bd7c7e-1f1c-4d78-9a79-142e4f5c3478'} Aug 26 01:00:40.604346 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 01:00:40.604346 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:00:40.604346 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 01:00:40.604346 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 01:00:40.604346 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 01:00:40.604346 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 01:00:40.604346 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 01:00:40.604346 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 01:00:40.604346 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 01:00:40.604346 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 01:00:40.604346 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33bd7c7e-1f1c-4d78-9a79-142e4f5c3478 could not be found. Aug 26 01:00:40.604346 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:00:40.604346 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:00:40.604346 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:00:40.604346 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:00:40.604346 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:00:40.604346 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:00:40.604346 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 01:00:40.604346 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 01:00:40.604346 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 01:00:40.605988 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 01:00:40.605988 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 01:00:40.605988 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 01:00:40.605988 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 01:00:40.605988 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 01:00:40.605988 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 01:00:40.605988 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 01:00:40.605988 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33bd7c7e-1f1c-4d78-9a79-142e4f5c3478 could not be found. Aug 26 01:00:40.605988 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:00:40.605988 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:00:40.605988 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:00:40.605988 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:00:40.605988 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:00:40.605988 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:00:40.605988 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 01:00:40.605988 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 01:00:40.605988 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33bd7c7e-1f1c-4d78-9a79-142e4f5c3478 could not be found. Aug 26 01:00:40.605988 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:00:40.607401 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-49cbccd2-c171-4b07-8400-d8472d0146da tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Returning 404 to user: Instance 33bd7c7e-1f1c-4d78-9a79-142e4f5c3478 could not be found. {{(pid=127564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 01:00:40.607401 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-49cbccd2-c171-4b07-8400-d8472d0146da tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478" status: 404 len: 111 microversion: 2.1 time: 0.032479 Aug 26 01:00:40.607401 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 414/826] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:00:40 2022] GET /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 01:00:40.607658 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-ea1636de-389b-421a-919c-d5989ed3f1eb tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '.version_select at 0x7f8a92c93d30>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:40.677847 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-ea1636de-389b-421a-919c-d5989ed3f1eb tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-165489234" status: 202 len: 0 microversion: 2.1 time: 0.074682 Aug 26 01:00:40.678442 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 413/827] 10.222.0.59 () {58 vars in 1218 bytes} [Fri Aug 26 01:00:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-165489234 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 01:00:43.962079 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-2bfec371-55ea-4def-91cd-782ad7865b98 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:43.963306 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-2bfec371-55ea-4def-91cd-782ad7865b98 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 33bd7c7e-1f1c-4d78-9a79-142e4f5c3478] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:00:43.969195 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2bfec371-55ea-4def-91cd-782ad7865b98 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:43.969669 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2bfec371-55ea-4def-91cd-782ad7865b98 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:43.970101 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2bfec371-55ea-4def-91cd-782ad7865b98 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:43.970778 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2bfec371-55ea-4def-91cd-782ad7865b98 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:43.971726 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2bfec371-55ea-4def-91cd-782ad7865b98 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:43.972147 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2bfec371-55ea-4def-91cd-782ad7865b98 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:43.985387 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.wsgi [None req-2bfec371-55ea-4def-91cd-782ad7865b98 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] HTTP exception thrown: Instance 33bd7c7e-1f1c-4d78-9a79-142e4f5c3478 could not be found. Aug 26 01:00:43.988287 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-2bfec371-55ea-4def-91cd-782ad7865b98 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Request method failure captured: Aug 26 01:00:43.988287 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: request: DELETE /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478 HTTP/1.1 Aug 26 01:00:43.988287 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Accept: application/json Aug 26 01:00:43.988287 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Accept-Encoding: identity Aug 26 01:00:43.988287 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Connection: close Aug 26 01:00:43.988287 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Content-Length: 0 Aug 26 01:00:43.988287 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Content-Type: application/json Aug 26 01:00:43.988287 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Host: 10.222.0.59 Aug 26 01:00:43.988287 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Openstack-System-Scope: None Aug 26 01:00:43.988287 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: User-Agent: python-urllib3/1.26.11 Aug 26 01:00:43.988287 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Auth-Token: gAAAAABjCBmiJo3kHvT10T9Jjy1jBOSn7Bvzod408w2BCSd4FzzPtblMjSj90SuE4WhMVZE2OrkiKwE92EB5k_lvN938POeSncFplvwObTb9e_H71QzgJINEFj-VDMGTlVcWf_-YnYu6U7ZMq5okhfSfjxKfk0TZV25UNGIJCVy-wTX5xriWOMY Aug 26 01:00:43.988287 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Domain-Id: None Aug 26 01:00:43.988287 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Domain-Name: None Aug 26 01:00:43.988287 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Identity-Status: Confirmed Aug 26 01:00:43.988287 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Is-Admin-Project: True Aug 26 01:00:43.988287 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Domain-Id: default Aug 26 01:00:43.988287 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Domain-Name: Default Aug 26 01:00:43.988287 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Id: 5219060f4c184521919b017e8435eca5 Aug 26 01:00:43.988287 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Name: tempest-AttachVolumeTestJSON-921770591 Aug 26 01:00:43.988287 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Role: reader,member Aug 26 01:00:43.988287 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Roles: reader,member Aug 26 01:00:43.992844 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5219060f4c184521919b017e8435eca5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5219060f4c184521919b017e8435eca5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5219060f4c184521919b017e8435eca5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5219060f4c184521919b017e8435eca5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 01:00:43.992844 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant: tempest-AttachVolumeTestJSON-921770591 Aug 26 01:00:43.992844 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant-Id: 5219060f4c184521919b017e8435eca5 Aug 26 01:00:43.992844 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant-Name: tempest-AttachVolumeTestJSON-921770591 Aug 26 01:00:43.992844 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User: tempest-AttachVolumeTestJSON-921770591-project Aug 26 01:00:43.992844 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Domain-Id: default Aug 26 01:00:43.992844 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Domain-Name: Default Aug 26 01:00:43.992844 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Id: 0175a2b440704d51aa14607a2e20e36a Aug 26 01:00:43.992844 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Name: tempest-AttachVolumeTestJSON-921770591-project Aug 26 01:00:43.992844 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: method: > Aug 26 01:00:43.992844 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: exception: Instance 33bd7c7e-1f1c-4d78-9a79-142e4f5c3478 could not be found. Aug 26 01:00:43.992844 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: action_args: {'id': '33bd7c7e-1f1c-4d78-9a79-142e4f5c3478'} Aug 26 01:00:43.993732 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 01:00:43.993732 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:00:43.993732 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 01:00:43.993732 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 01:00:43.993732 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 01:00:43.993732 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 01:00:43.993732 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 01:00:43.993732 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 01:00:43.993732 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 01:00:43.993732 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 01:00:43.993732 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33bd7c7e-1f1c-4d78-9a79-142e4f5c3478 could not be found. Aug 26 01:00:43.993732 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:00:43.993732 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:00:43.993732 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:00:43.993732 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:00:43.993732 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:00:43.993732 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:00:43.993732 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 01:00:43.993732 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 01:00:43.993732 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 01:00:43.995269 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 01:00:43.995269 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 01:00:43.995269 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 01:00:43.995269 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 01:00:43.995269 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 01:00:43.995269 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 01:00:43.995269 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 01:00:43.995269 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 01:00:43.995269 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 01:00:43.995269 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33bd7c7e-1f1c-4d78-9a79-142e4f5c3478 could not be found. Aug 26 01:00:43.995269 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:00:43.995269 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:00:43.995269 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:00:43.995269 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:00:43.995269 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:00:43.995269 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:00:43.995269 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 01:00:43.995269 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 01:00:43.995269 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33bd7c7e-1f1c-4d78-9a79-142e4f5c3478 could not be found. Aug 26 01:00:43.995269 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:00:43.996918 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-2bfec371-55ea-4def-91cd-782ad7865b98 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Returning 404 to user: Instance 33bd7c7e-1f1c-4d78-9a79-142e4f5c3478 could not be found. {{(pid=127564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 01:00:43.996918 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-2bfec371-55ea-4def-91cd-782ad7865b98 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "DELETE /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478" status: 404 len: 111 microversion: 2.1 time: 0.030709 Aug 26 01:00:43.996918 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 415/828] 10.222.0.59 () {58 vars in 1239 bytes} [Fri Aug 26 01:00:43 2022] DELETE /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 01:00:43.997798 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-5060cb97-dcf8-42f6-8ee4-6a136e63be71 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:43.998410 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-5060cb97-dcf8-42f6-8ee4-6a136e63be71 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 33bd7c7e-1f1c-4d78-9a79-142e4f5c3478] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:00:44.005004 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5060cb97-dcf8-42f6-8ee4-6a136e63be71 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:44.005485 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5060cb97-dcf8-42f6-8ee4-6a136e63be71 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:44.005918 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5060cb97-dcf8-42f6-8ee4-6a136e63be71 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:44.006643 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5060cb97-dcf8-42f6-8ee4-6a136e63be71 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:44.007052 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5060cb97-dcf8-42f6-8ee4-6a136e63be71 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:44.007473 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5060cb97-dcf8-42f6-8ee4-6a136e63be71 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:44.022845 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.wsgi [None req-5060cb97-dcf8-42f6-8ee4-6a136e63be71 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] HTTP exception thrown: Instance 33bd7c7e-1f1c-4d78-9a79-142e4f5c3478 could not be found. Aug 26 01:00:44.024503 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-5060cb97-dcf8-42f6-8ee4-6a136e63be71 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Request method failure captured: Aug 26 01:00:44.024503 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: request: GET /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478 HTTP/1.1 Aug 26 01:00:44.024503 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Accept: application/json Aug 26 01:00:44.024503 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Accept-Encoding: identity Aug 26 01:00:44.024503 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Connection: close Aug 26 01:00:44.024503 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Content-Length: 0 Aug 26 01:00:44.024503 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Content-Type: application/json Aug 26 01:00:44.024503 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Host: 10.222.0.59 Aug 26 01:00:44.024503 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Openstack-System-Scope: None Aug 26 01:00:44.024503 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: User-Agent: python-urllib3/1.26.11 Aug 26 01:00:44.024503 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Auth-Token: gAAAAABjCBmiJo3kHvT10T9Jjy1jBOSn7Bvzod408w2BCSd4FzzPtblMjSj90SuE4WhMVZE2OrkiKwE92EB5k_lvN938POeSncFplvwObTb9e_H71QzgJINEFj-VDMGTlVcWf_-YnYu6U7ZMq5okhfSfjxKfk0TZV25UNGIJCVy-wTX5xriWOMY Aug 26 01:00:44.024503 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Domain-Id: None Aug 26 01:00:44.024503 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Domain-Name: None Aug 26 01:00:44.024503 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Identity-Status: Confirmed Aug 26 01:00:44.024503 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Is-Admin-Project: True Aug 26 01:00:44.024503 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Domain-Id: default Aug 26 01:00:44.024503 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Domain-Name: Default Aug 26 01:00:44.024503 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Id: 5219060f4c184521919b017e8435eca5 Aug 26 01:00:44.024503 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Name: tempest-AttachVolumeTestJSON-921770591 Aug 26 01:00:44.024503 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Role: reader,member Aug 26 01:00:44.024503 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Roles: reader,member Aug 26 01:00:44.026016 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5219060f4c184521919b017e8435eca5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5219060f4c184521919b017e8435eca5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5219060f4c184521919b017e8435eca5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5219060f4c184521919b017e8435eca5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 01:00:44.026016 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant: tempest-AttachVolumeTestJSON-921770591 Aug 26 01:00:44.026016 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant-Id: 5219060f4c184521919b017e8435eca5 Aug 26 01:00:44.026016 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant-Name: tempest-AttachVolumeTestJSON-921770591 Aug 26 01:00:44.026016 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User: tempest-AttachVolumeTestJSON-921770591-project Aug 26 01:00:44.026016 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Domain-Id: default Aug 26 01:00:44.026016 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Domain-Name: Default Aug 26 01:00:44.026016 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Id: 0175a2b440704d51aa14607a2e20e36a Aug 26 01:00:44.026016 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Name: tempest-AttachVolumeTestJSON-921770591-project Aug 26 01:00:44.026016 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: method: > Aug 26 01:00:44.026016 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: exception: Instance 33bd7c7e-1f1c-4d78-9a79-142e4f5c3478 could not be found. Aug 26 01:00:44.026016 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: action_args: {'id': '33bd7c7e-1f1c-4d78-9a79-142e4f5c3478'} Aug 26 01:00:44.026773 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 01:00:44.026773 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:00:44.026773 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 01:00:44.026773 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 01:00:44.026773 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 01:00:44.026773 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 01:00:44.026773 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 01:00:44.026773 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 01:00:44.026773 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 01:00:44.026773 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 01:00:44.026773 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33bd7c7e-1f1c-4d78-9a79-142e4f5c3478 could not be found. Aug 26 01:00:44.026773 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:00:44.026773 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:00:44.026773 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:00:44.026773 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:00:44.026773 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:00:44.026773 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:00:44.026773 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 01:00:44.026773 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 01:00:44.026773 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 01:00:44.028017 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 01:00:44.028017 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 01:00:44.028017 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 01:00:44.028017 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 01:00:44.028017 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 01:00:44.028017 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 01:00:44.028017 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 01:00:44.028017 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33bd7c7e-1f1c-4d78-9a79-142e4f5c3478 could not be found. Aug 26 01:00:44.028017 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:00:44.028017 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:00:44.028017 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:00:44.028017 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:00:44.028017 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:00:44.028017 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:00:44.028017 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 01:00:44.028017 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 01:00:44.028017 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33bd7c7e-1f1c-4d78-9a79-142e4f5c3478 could not be found. Aug 26 01:00:44.028017 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:00:44.029157 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-5060cb97-dcf8-42f6-8ee4-6a136e63be71 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Returning 404 to user: Instance 33bd7c7e-1f1c-4d78-9a79-142e4f5c3478 could not be found. {{(pid=127565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 01:00:44.029157 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-5060cb97-dcf8-42f6-8ee4-6a136e63be71 tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478" status: 404 len: 111 microversion: 2.1 time: 0.032361 Aug 26 01:00:44.029157 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 414/829] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:00:43 2022] GET /compute/v2.1/servers/33bd7c7e-1f1c-4d78-9a79-142e4f5c3478 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 01:00:45.337660 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-5c763c7a-35e6-40b2-8f12-386c6280d0bd tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:45.338139 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-5c763c7a-35e6-40b2-8f12-386c6280d0bd tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:00:45.344448 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5c763c7a-35e6-40b2-8f12-386c6280d0bd tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:45.344968 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5c763c7a-35e6-40b2-8f12-386c6280d0bd tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:45.345405 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5c763c7a-35e6-40b2-8f12-386c6280d0bd tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:45.346592 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5c763c7a-35e6-40b2-8f12-386c6280d0bd tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:45.347044 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5c763c7a-35e6-40b2-8f12-386c6280d0bd tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:45.347471 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5c763c7a-35e6-40b2-8f12-386c6280d0bd tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:45.360733 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.wsgi [None req-5c763c7a-35e6-40b2-8f12-386c6280d0bd tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] HTTP exception thrown: Instance 730816fc-0c43-43e3-ab6e-e7f324e403d7 could not be found. Aug 26 01:00:45.362863 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-5c763c7a-35e6-40b2-8f12-386c6280d0bd tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Request method failure captured: Aug 26 01:00:45.362863 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: request: DELETE /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 HTTP/1.1 Aug 26 01:00:45.362863 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Accept: application/json Aug 26 01:00:45.362863 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Accept-Encoding: identity Aug 26 01:00:45.362863 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Connection: close Aug 26 01:00:45.362863 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Content-Length: 0 Aug 26 01:00:45.362863 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Content-Type: application/json Aug 26 01:00:45.362863 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Host: 10.222.0.59 Aug 26 01:00:45.362863 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Openstack-System-Scope: None Aug 26 01:00:45.362863 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: User-Agent: python-urllib3/1.26.11 Aug 26 01:00:45.362863 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Auth-Token: gAAAAABjCBmiJo3kHvT10T9Jjy1jBOSn7Bvzod408w2BCSd4FzzPtblMjSj90SuE4WhMVZE2OrkiKwE92EB5k_lvN938POeSncFplvwObTb9e_H71QzgJINEFj-VDMGTlVcWf_-YnYu6U7ZMq5okhfSfjxKfk0TZV25UNGIJCVy-wTX5xriWOMY Aug 26 01:00:45.362863 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Domain-Id: None Aug 26 01:00:45.362863 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Domain-Name: None Aug 26 01:00:45.362863 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Identity-Status: Confirmed Aug 26 01:00:45.362863 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Is-Admin-Project: True Aug 26 01:00:45.362863 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Domain-Id: default Aug 26 01:00:45.362863 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Domain-Name: Default Aug 26 01:00:45.362863 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Id: 5219060f4c184521919b017e8435eca5 Aug 26 01:00:45.362863 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Name: tempest-AttachVolumeTestJSON-921770591 Aug 26 01:00:45.362863 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Role: reader,member Aug 26 01:00:45.362863 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Roles: reader,member Aug 26 01:00:45.364514 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5219060f4c184521919b017e8435eca5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5219060f4c184521919b017e8435eca5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5219060f4c184521919b017e8435eca5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5219060f4c184521919b017e8435eca5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 01:00:45.364514 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant: tempest-AttachVolumeTestJSON-921770591 Aug 26 01:00:45.364514 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant-Id: 5219060f4c184521919b017e8435eca5 Aug 26 01:00:45.364514 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant-Name: tempest-AttachVolumeTestJSON-921770591 Aug 26 01:00:45.364514 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User: tempest-AttachVolumeTestJSON-921770591-project Aug 26 01:00:45.364514 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Domain-Id: default Aug 26 01:00:45.364514 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Domain-Name: Default Aug 26 01:00:45.364514 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Id: 0175a2b440704d51aa14607a2e20e36a Aug 26 01:00:45.364514 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Name: tempest-AttachVolumeTestJSON-921770591-project Aug 26 01:00:45.364514 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: method: > Aug 26 01:00:45.364514 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: exception: Instance 730816fc-0c43-43e3-ab6e-e7f324e403d7 could not be found. Aug 26 01:00:45.364514 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: action_args: {'id': '730816fc-0c43-43e3-ab6e-e7f324e403d7'} Aug 26 01:00:45.365664 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 01:00:45.365664 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:00:45.365664 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 01:00:45.365664 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 01:00:45.365664 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 01:00:45.365664 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 01:00:45.365664 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 01:00:45.365664 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 01:00:45.365664 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 01:00:45.365664 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 01:00:45.365664 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 730816fc-0c43-43e3-ab6e-e7f324e403d7 could not be found. Aug 26 01:00:45.365664 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:00:45.365664 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:00:45.365664 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:00:45.365664 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:00:45.365664 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:00:45.365664 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:00:45.365664 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 01:00:45.365664 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 01:00:45.365664 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 01:00:45.367147 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 01:00:45.367147 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 01:00:45.367147 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 01:00:45.367147 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 01:00:45.367147 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 01:00:45.367147 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 01:00:45.367147 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 01:00:45.367147 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 01:00:45.367147 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 01:00:45.367147 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 730816fc-0c43-43e3-ab6e-e7f324e403d7 could not be found. Aug 26 01:00:45.367147 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:00:45.367147 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:00:45.367147 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:00:45.367147 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:00:45.367147 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:00:45.367147 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:00:45.367147 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 01:00:45.367147 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 01:00:45.367147 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 730816fc-0c43-43e3-ab6e-e7f324e403d7 could not be found. Aug 26 01:00:45.367147 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:00:45.368708 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-5c763c7a-35e6-40b2-8f12-386c6280d0bd tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Returning 404 to user: Instance 730816fc-0c43-43e3-ab6e-e7f324e403d7 could not be found. {{(pid=127564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 01:00:45.368708 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-5c763c7a-35e6-40b2-8f12-386c6280d0bd tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "DELETE /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 404 len: 111 microversion: 2.1 time: 0.030501 Aug 26 01:00:45.368708 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 416/830] 10.222.0.59 () {58 vars in 1239 bytes} [Fri Aug 26 01:00:45 2022] DELETE /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 01:00:45.372646 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-407e8832-ecab-4b37-b082-6fa24ccd96fa tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:45.373262 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-407e8832-ecab-4b37-b082-6fa24ccd96fa tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] [instance: 730816fc-0c43-43e3-ab6e-e7f324e403d7] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:00:45.379600 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-407e8832-ecab-4b37-b082-6fa24ccd96fa tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:45.384160 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-407e8832-ecab-4b37-b082-6fa24ccd96fa tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:45.384160 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-407e8832-ecab-4b37-b082-6fa24ccd96fa tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:45.384160 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-407e8832-ecab-4b37-b082-6fa24ccd96fa tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:45.384160 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-407e8832-ecab-4b37-b082-6fa24ccd96fa tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:45.384577 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-407e8832-ecab-4b37-b082-6fa24ccd96fa tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:45.545239 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.wsgi [None req-407e8832-ecab-4b37-b082-6fa24ccd96fa tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] HTTP exception thrown: Instance 730816fc-0c43-43e3-ab6e-e7f324e403d7 could not be found. Aug 26 01:00:45.546772 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-407e8832-ecab-4b37-b082-6fa24ccd96fa tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Request method failure captured: Aug 26 01:00:45.546772 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: request: GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 HTTP/1.1 Aug 26 01:00:45.546772 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Accept: application/json Aug 26 01:00:45.546772 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Accept-Encoding: identity Aug 26 01:00:45.546772 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Connection: close Aug 26 01:00:45.546772 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Content-Length: 0 Aug 26 01:00:45.546772 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Content-Type: application/json Aug 26 01:00:45.546772 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Host: 10.222.0.59 Aug 26 01:00:45.546772 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Openstack-System-Scope: None Aug 26 01:00:45.546772 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: User-Agent: python-urllib3/1.26.11 Aug 26 01:00:45.546772 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Auth-Token: gAAAAABjCBmiJo3kHvT10T9Jjy1jBOSn7Bvzod408w2BCSd4FzzPtblMjSj90SuE4WhMVZE2OrkiKwE92EB5k_lvN938POeSncFplvwObTb9e_H71QzgJINEFj-VDMGTlVcWf_-YnYu6U7ZMq5okhfSfjxKfk0TZV25UNGIJCVy-wTX5xriWOMY Aug 26 01:00:45.546772 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Domain-Id: None Aug 26 01:00:45.546772 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Domain-Name: None Aug 26 01:00:45.546772 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Identity-Status: Confirmed Aug 26 01:00:45.546772 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Is-Admin-Project: True Aug 26 01:00:45.546772 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Domain-Id: default Aug 26 01:00:45.546772 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Domain-Name: Default Aug 26 01:00:45.546772 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Id: 5219060f4c184521919b017e8435eca5 Aug 26 01:00:45.546772 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Name: tempest-AttachVolumeTestJSON-921770591 Aug 26 01:00:45.546772 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Role: reader,member Aug 26 01:00:45.546772 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Roles: reader,member Aug 26 01:00:45.548346 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5219060f4c184521919b017e8435eca5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5219060f4c184521919b017e8435eca5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5219060f4c184521919b017e8435eca5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5219060f4c184521919b017e8435eca5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 01:00:45.548346 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant: tempest-AttachVolumeTestJSON-921770591 Aug 26 01:00:45.548346 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant-Id: 5219060f4c184521919b017e8435eca5 Aug 26 01:00:45.548346 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant-Name: tempest-AttachVolumeTestJSON-921770591 Aug 26 01:00:45.548346 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User: tempest-AttachVolumeTestJSON-921770591-project Aug 26 01:00:45.548346 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Domain-Id: default Aug 26 01:00:45.548346 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Domain-Name: Default Aug 26 01:00:45.548346 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Id: 0175a2b440704d51aa14607a2e20e36a Aug 26 01:00:45.548346 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Name: tempest-AttachVolumeTestJSON-921770591-project Aug 26 01:00:45.548346 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: method: > Aug 26 01:00:45.548346 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: exception: Instance 730816fc-0c43-43e3-ab6e-e7f324e403d7 could not be found. Aug 26 01:00:45.548346 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: action_args: {'id': '730816fc-0c43-43e3-ab6e-e7f324e403d7'} Aug 26 01:00:45.549502 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 01:00:45.549502 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:00:45.549502 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 01:00:45.549502 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 01:00:45.549502 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 01:00:45.549502 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 01:00:45.549502 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 01:00:45.549502 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 01:00:45.549502 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 01:00:45.549502 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 01:00:45.549502 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 730816fc-0c43-43e3-ab6e-e7f324e403d7 could not be found. Aug 26 01:00:45.549502 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:00:45.549502 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:00:45.549502 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:00:45.549502 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:00:45.549502 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:00:45.549502 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:00:45.549502 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 01:00:45.549502 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 01:00:45.549502 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 01:00:45.550966 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 01:00:45.550966 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 01:00:45.550966 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 01:00:45.550966 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 01:00:45.550966 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 01:00:45.550966 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 01:00:45.550966 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 01:00:45.550966 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 730816fc-0c43-43e3-ab6e-e7f324e403d7 could not be found. Aug 26 01:00:45.550966 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:00:45.550966 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:00:45.550966 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:00:45.550966 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:00:45.550966 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:00:45.550966 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:00:45.550966 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 01:00:45.550966 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 01:00:45.550966 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 730816fc-0c43-43e3-ab6e-e7f324e403d7 could not be found. Aug 26 01:00:45.550966 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:00:45.552505 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-407e8832-ecab-4b37-b082-6fa24ccd96fa tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] Returning 404 to user: Instance 730816fc-0c43-43e3-ab6e-e7f324e403d7 could not be found. {{(pid=127565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 01:00:45.552505 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-407e8832-ecab-4b37-b082-6fa24ccd96fa tempest-AttachVolumeTestJSON-921770591 tempest-AttachVolumeTestJSON-921770591-project] 10.222.0.59 "GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7" status: 404 len: 111 microversion: 2.1 time: 0.179370 Aug 26 01:00:45.552505 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 415/831] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:00:45 2022] GET /compute/v2.1/servers/730816fc-0c43-43e3-ab6e-e7f324e403d7 => generated 111 bytes in 181 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 01:00:51.172316 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-279aadbf-0559-45af-ab42-ed9d863fb4b8 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:51.176227 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-279aadbf-0559-45af-ab42-ed9d863fb4b8 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:00:51.182807 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-279aadbf-0559-45af-ab42-ed9d863fb4b8 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:51.183551 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-279aadbf-0559-45af-ab42-ed9d863fb4b8 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:51.184130 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-279aadbf-0559-45af-ab42-ed9d863fb4b8 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:51.184976 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-279aadbf-0559-45af-ab42-ed9d863fb4b8 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:51.185777 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-279aadbf-0559-45af-ab42-ed9d863fb4b8 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:51.186315 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-279aadbf-0559-45af-ab42-ed9d863fb4b8 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:51.220397 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-279aadbf-0559-45af-ab42-ed9d863fb4b8 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.053650 Aug 26 01:00:51.223264 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 417/832] 10.222.0.59 () {60 vars in 1343 bytes} [Fri Aug 26 01:00:51 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:00:51.285666 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-3f55cea7-16db-41c3-94d7-d58dda09f158 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:51.286227 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-3f55cea7-16db-41c3-94d7-d58dda09f158 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:00:51.292489 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3f55cea7-16db-41c3-94d7-d58dda09f158 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:51.292973 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3f55cea7-16db-41c3-94d7-d58dda09f158 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:51.293410 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3f55cea7-16db-41c3-94d7-d58dda09f158 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:51.294368 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3f55cea7-16db-41c3-94d7-d58dda09f158 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:51.294521 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3f55cea7-16db-41c3-94d7-d58dda09f158 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:51.294945 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3f55cea7-16db-41c3-94d7-d58dda09f158 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:51.320345 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-3f55cea7-16db-41c3-94d7-d58dda09f158 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Going to try to terminate instance {{(pid=127565) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 01:00:51.614751 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-3f55cea7-16db-41c3-94d7-d58dda09f158 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "DELETE /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 204 len: 0 microversion: 2.20 time: 0.332929 Aug 26 01:00:51.615504 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 416/833] 10.222.0.59 () {60 vars in 1280 bytes} [Fri Aug 26 01:00:51 2022] DELETE /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 26 01:00:51.623711 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-1d4a7f3e-834a-4083-a979-2e49fffa0d5c tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:51.624322 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-1d4a7f3e-834a-4083-a979-2e49fffa0d5c tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:00:51.631167 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1d4a7f3e-834a-4083-a979-2e49fffa0d5c tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:51.631647 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1d4a7f3e-834a-4083-a979-2e49fffa0d5c tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:51.632088 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1d4a7f3e-834a-4083-a979-2e49fffa0d5c tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:51.632839 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1d4a7f3e-834a-4083-a979-2e49fffa0d5c tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:51.633351 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1d4a7f3e-834a-4083-a979-2e49fffa0d5c tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:51.633748 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1d4a7f3e-834a-4083-a979-2e49fffa0d5c tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:51.792683 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-1d4a7f3e-834a-4083-a979-2e49fffa0d5c tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:51.801724 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-1d4a7f3e-834a-4083-a979-2e49fffa0d5c tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:51.803200 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-1d4a7f3e-834a-4083-a979-2e49fffa0d5c tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:51.804685 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-1d4a7f3e-834a-4083-a979-2e49fffa0d5c tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 200 len: 1723 microversion: 2.20 time: 0.184661 Aug 26 01:00:51.805311 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 418/834] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 01:00:51 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 01:00:52.828142 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-d59823ed-0ea7-47a4-a493-bc5c098ea55c tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:52.828938 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-d59823ed-0ea7-47a4-a493-bc5c098ea55c tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:00:52.836128 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d59823ed-0ea7-47a4-a493-bc5c098ea55c tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:52.836665 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d59823ed-0ea7-47a4-a493-bc5c098ea55c tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:52.837105 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d59823ed-0ea7-47a4-a493-bc5c098ea55c tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:52.842768 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d59823ed-0ea7-47a4-a493-bc5c098ea55c tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:52.842768 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d59823ed-0ea7-47a4-a493-bc5c098ea55c tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:52.842768 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d59823ed-0ea7-47a4-a493-bc5c098ea55c tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:53.001006 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-d59823ed-0ea7-47a4-a493-bc5c098ea55c tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:53.009822 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-d59823ed-0ea7-47a4-a493-bc5c098ea55c tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:53.011323 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-d59823ed-0ea7-47a4-a493-bc5c098ea55c tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:53.028658 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-d59823ed-0ea7-47a4-a493-bc5c098ea55c tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 200 len: 1723 microversion: 2.20 time: 0.189105 Aug 26 01:00:53.028658 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 417/835] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 01:00:52 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 01:00:54.039264 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-8db53d66-9f16-44c7-af95-ff1213e15899 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:54.040747 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-8db53d66-9f16-44c7-af95-ff1213e15899 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:00:54.046394 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8db53d66-9f16-44c7-af95-ff1213e15899 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:54.047064 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8db53d66-9f16-44c7-af95-ff1213e15899 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:54.047501 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8db53d66-9f16-44c7-af95-ff1213e15899 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:54.048207 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8db53d66-9f16-44c7-af95-ff1213e15899 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:54.049281 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8db53d66-9f16-44c7-af95-ff1213e15899 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:54.049707 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8db53d66-9f16-44c7-af95-ff1213e15899 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:54.441737 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-8db53d66-9f16-44c7-af95-ff1213e15899 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:54.450802 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-8db53d66-9f16-44c7-af95-ff1213e15899 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:54.452630 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-8db53d66-9f16-44c7-af95-ff1213e15899 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:54.453702 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-8db53d66-9f16-44c7-af95-ff1213e15899 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 200 len: 1723 microversion: 2.20 time: 0.420659 Aug 26 01:00:54.454333 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 419/836] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 01:00:54 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 1723 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 01:00:55.282567 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [req-51dd509f-03f1-42f8-9cfb-eb71a6228a9a req-e42a9b86-431a-43b0-9bac-165c21e44049 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8af18a63-5c10-4530-9072-6ca92223b8ec", "name": "network-vif-deleted", "tag": "abc8d4e4-fe47-4480-9cbb-c4ca4d73b355"}]} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:00:55.294731 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-51dd509f-03f1-42f8-9cfb-eb71a6228a9a req-e42a9b86-431a-43b0-9bac-165c21e44049 service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:55.295217 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-51dd509f-03f1-42f8-9cfb-eb71a6228a9a req-e42a9b86-431a-43b0-9bac-165c21e44049 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:55.295650 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-51dd509f-03f1-42f8-9cfb-eb71a6228a9a req-e42a9b86-431a-43b0-9bac-165c21e44049 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:55.307775 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.compute.server_external_events [req-51dd509f-03f1-42f8-9cfb-eb71a6228a9a req-e42a9b86-431a-43b0-9bac-165c21e44049 service nova] Creating event network-vif-deleted:abc8d4e4-fe47-4480-9cbb-c4ca4d73b355 for instance 8af18a63-5c10-4530-9072-6ca92223b8ec on hv-cinder-83538 Aug 26 01:00:55.312957 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [req-51dd509f-03f1-42f8-9cfb-eb71a6228a9a req-e42a9b86-431a-43b0-9bac-165c21e44049 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034815 Aug 26 01:00:55.313693 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 418/837] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 01:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:00:55.483636 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-9c9150e9-738f-482f-bee5-eaf3e36da930 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:55.484250 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-9c9150e9-738f-482f-bee5-eaf3e36da930 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:00:55.506035 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9c9150e9-738f-482f-bee5-eaf3e36da930 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:55.506535 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9c9150e9-738f-482f-bee5-eaf3e36da930 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:55.507663 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9c9150e9-738f-482f-bee5-eaf3e36da930 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:55.508606 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9c9150e9-738f-482f-bee5-eaf3e36da930 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:55.513607 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9c9150e9-738f-482f-bee5-eaf3e36da930 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:55.514310 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9c9150e9-738f-482f-bee5-eaf3e36da930 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:55.622744 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-9c9150e9-738f-482f-bee5-eaf3e36da930 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:55.638042 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-9c9150e9-738f-482f-bee5-eaf3e36da930 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:55.643849 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-9c9150e9-738f-482f-bee5-eaf3e36da930 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34240c306dc54f0c8758dbb4b4525376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec39c32378ac4017ad50aa6f930e514b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:00:55.646227 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-9c9150e9-738f-482f-bee5-eaf3e36da930 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 200 len: 1365 microversion: 2.20 time: 0.170794 Aug 26 01:00:55.649170 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 420/838] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 01:00:55 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 01:00:56.677695 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-864a5395-444b-4b7d-9f18-3240c73ea7f0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:56.677695 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-864a5395-444b-4b7d-9f18-3240c73ea7f0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:00:56.684382 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-864a5395-444b-4b7d-9f18-3240c73ea7f0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:56.685108 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-864a5395-444b-4b7d-9f18-3240c73ea7f0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:56.685698 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-864a5395-444b-4b7d-9f18-3240c73ea7f0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:56.687282 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-864a5395-444b-4b7d-9f18-3240c73ea7f0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:56.687899 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-864a5395-444b-4b7d-9f18-3240c73ea7f0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:56.688496 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-864a5395-444b-4b7d-9f18-3240c73ea7f0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:56.705044 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.wsgi [None req-864a5395-444b-4b7d-9f18-3240c73ea7f0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] HTTP exception thrown: Instance 8af18a63-5c10-4530-9072-6ca92223b8ec could not be found. Aug 26 01:00:56.706870 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-864a5395-444b-4b7d-9f18-3240c73ea7f0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Request method failure captured: Aug 26 01:00:56.706870 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: request: GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec HTTP/1.1 Aug 26 01:00:56.706870 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Accept: application/json Aug 26 01:00:56.706870 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Accept-Encoding: identity Aug 26 01:00:56.706870 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Connection: close Aug 26 01:00:56.706870 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Content-Length: 0 Aug 26 01:00:56.706870 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Content-Type: application/json Aug 26 01:00:56.706870 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Host: 10.222.0.59 Aug 26 01:00:56.706870 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Openstack-System-Scope: None Aug 26 01:00:56.706870 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: User-Agent: python-urllib3/1.26.11 Aug 26 01:00:56.706870 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Auth-Token: gAAAAABjCBmgyDDgilWQYDV3Pt1Em3kTCxsE41M0vbwJrr1Rqja-DMZaIcX5WNaG7FxAXeyifEVBYFh6_R904f-XKGQt3qooDi2aWUs0Asz3CfbSPUljnbPhu8WqCIlc-fkFdpvaLdAPObY8uyEVhiLqyDKxGxdz6WKuxtkKvk5v_G0Cg36QQHc Aug 26 01:00:56.706870 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Domain-Id: None Aug 26 01:00:56.706870 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Domain-Name: None Aug 26 01:00:56.706870 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Identity-Status: Confirmed Aug 26 01:00:56.706870 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Is-Admin-Project: True Aug 26 01:00:56.706870 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Openstack-Nova-Api-Version: 2.20 Aug 26 01:00:56.706870 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Domain-Id: default Aug 26 01:00:56.706870 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Domain-Name: Default Aug 26 01:00:56.706870 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Id: ec39c32378ac4017ad50aa6f930e514b Aug 26 01:00:56.706870 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-700972569 Aug 26 01:00:56.706870 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Role: reader,member Aug 26 01:00:56.706870 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Roles: reader,member Aug 26 01:00:56.708314 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ec39c32378ac4017ad50aa6f930e514b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ec39c32378ac4017ad50aa6f930e514b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ec39c32378ac4017ad50aa6f930e514b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ec39c32378ac4017ad50aa6f930e514b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 01:00:56.708314 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant: tempest-AttachVolumeShelveTestJSON-700972569 Aug 26 01:00:56.708314 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant-Id: ec39c32378ac4017ad50aa6f930e514b Aug 26 01:00:56.708314 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-700972569 Aug 26 01:00:56.708314 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User: tempest-AttachVolumeShelveTestJSON-700972569-project Aug 26 01:00:56.708314 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Domain-Id: default Aug 26 01:00:56.708314 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Domain-Name: Default Aug 26 01:00:56.708314 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Id: 34240c306dc54f0c8758dbb4b4525376 Aug 26 01:00:56.708314 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Name: tempest-AttachVolumeShelveTestJSON-700972569-project Aug 26 01:00:56.708314 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: method: > Aug 26 01:00:56.708314 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: exception: Instance 8af18a63-5c10-4530-9072-6ca92223b8ec could not be found. Aug 26 01:00:56.708314 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: action_args: {'id': '8af18a63-5c10-4530-9072-6ca92223b8ec'} Aug 26 01:00:56.709234 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 01:00:56.709234 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:00:56.709234 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 01:00:56.709234 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 01:00:56.709234 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 01:00:56.709234 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 01:00:56.709234 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 01:00:56.709234 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 01:00:56.709234 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 01:00:56.709234 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 01:00:56.709234 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8af18a63-5c10-4530-9072-6ca92223b8ec could not be found. Aug 26 01:00:56.709234 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:00:56.709234 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:00:56.709234 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:00:56.709234 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:00:56.709234 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:00:56.709234 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:00:56.709234 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 01:00:56.709234 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 01:00:56.709234 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 01:00:56.710494 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 01:00:56.710494 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 01:00:56.710494 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 01:00:56.710494 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 01:00:56.710494 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 01:00:56.710494 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 01:00:56.710494 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 01:00:56.710494 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8af18a63-5c10-4530-9072-6ca92223b8ec could not be found. Aug 26 01:00:56.710494 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:00:56.710494 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:00:56.710494 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:00:56.710494 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:00:56.710494 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:00:56.710494 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:00:56.710494 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 01:00:56.710494 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 01:00:56.710494 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8af18a63-5c10-4530-9072-6ca92223b8ec could not be found. Aug 26 01:00:56.710494 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:00:56.711666 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-864a5395-444b-4b7d-9f18-3240c73ea7f0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Returning 404 to user: Instance 8af18a63-5c10-4530-9072-6ca92223b8ec could not be found. {{(pid=127565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 01:00:56.711666 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-864a5395-444b-4b7d-9f18-3240c73ea7f0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 404 len: 111 microversion: 2.20 time: 0.040414 Aug 26 01:00:56.711666 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 419/839] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 01:00:56 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 26 01:00:56.721069 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-543df65a-173a-42b4-9cba-a12b86080756 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '.version_select at 0x7f8a966ce790>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:56.840639 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-543df65a-173a-42b4-9cba-a12b86080756 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-197231024" status: 204 len: 0 microversion: 2.20 time: 0.126766 Aug 26 01:00:56.843449 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 421/840] 10.222.0.59 () {60 vars in 1259 bytes} [Fri Aug 26 01:00:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-197231024 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 26 01:00:59.089238 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-a467664e-690b-4e48-8bb0-8b5d88aa5650 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Action: 'create', calling method: .version_select at 0x7f8a92c48d30>, body: {"keypair": {"name": "tempest-keypair-1253791505", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONRuZd3MzSulXf86XUTjWxdsjDLoFA/47Rw9LZQfUAZGQ/Ghwu2zUe2+rH2PLCW13bFJCEIQslct4P7EWaGE83ltJoIeEVgQyhRUiBhQpi/FECx4UaQtdWGhGNi/IJVGA=="}} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:00:59.106427 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.quota [None req-a467664e-690b-4e48-8bb0-8b5d88aa5650 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Getting quotas for project 03b021c415a147e08dbfede2ddc8cc27. Resources: {'key_pairs'} {{(pid=127565) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 01:00:59.110715 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.quota [None req-a467664e-690b-4e48-8bb0-8b5d88aa5650 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Getting quotas for user 38047508b7d44f05af7116a15ba7e319 and project 03b021c415a147e08dbfede2ddc8cc27. Resources: {'key_pairs'} {{(pid=127565) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 01:00:59.193763 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-a467664e-690b-4e48-8bb0-8b5d88aa5650 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.217624 Aug 26 01:00:59.194490 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 420/841] 10.222.0.59 () {60 vars in 1159 bytes} [Fri Aug 26 01:00:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:00:59.700656 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-ffca191d-6b8b-4cc1-8f00-a1772f626ff2 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:59.701186 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-ffca191d-6b8b-4cc1-8f00-a1772f626ff2 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:00:59.708600 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ffca191d-6b8b-4cc1-8f00-a1772f626ff2 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:59.709335 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ffca191d-6b8b-4cc1-8f00-a1772f626ff2 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:59.709770 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ffca191d-6b8b-4cc1-8f00-a1772f626ff2 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:59.711014 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ffca191d-6b8b-4cc1-8f00-a1772f626ff2 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:59.711547 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ffca191d-6b8b-4cc1-8f00-a1772f626ff2 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:59.712040 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ffca191d-6b8b-4cc1-8f00-a1772f626ff2 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:59.727220 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.wsgi [None req-ffca191d-6b8b-4cc1-8f00-a1772f626ff2 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] HTTP exception thrown: Instance 8af18a63-5c10-4530-9072-6ca92223b8ec could not be found. Aug 26 01:00:59.728972 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-ffca191d-6b8b-4cc1-8f00-a1772f626ff2 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Request method failure captured: Aug 26 01:00:59.728972 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: request: DELETE /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec HTTP/1.1 Aug 26 01:00:59.728972 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Accept: application/json Aug 26 01:00:59.728972 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Accept-Encoding: identity Aug 26 01:00:59.728972 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Connection: close Aug 26 01:00:59.728972 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Content-Length: 0 Aug 26 01:00:59.728972 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Content-Type: application/json Aug 26 01:00:59.728972 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Host: 10.222.0.59 Aug 26 01:00:59.728972 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Openstack-System-Scope: None Aug 26 01:00:59.728972 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: User-Agent: python-urllib3/1.26.11 Aug 26 01:00:59.728972 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Auth-Token: gAAAAABjCBmgyDDgilWQYDV3Pt1Em3kTCxsE41M0vbwJrr1Rqja-DMZaIcX5WNaG7FxAXeyifEVBYFh6_R904f-XKGQt3qooDi2aWUs0Asz3CfbSPUljnbPhu8WqCIlc-fkFdpvaLdAPObY8uyEVhiLqyDKxGxdz6WKuxtkKvk5v_G0Cg36QQHc Aug 26 01:00:59.728972 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Domain-Id: None Aug 26 01:00:59.728972 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Domain-Name: None Aug 26 01:00:59.728972 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Identity-Status: Confirmed Aug 26 01:00:59.728972 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Is-Admin-Project: True Aug 26 01:00:59.728972 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Openstack-Nova-Api-Version: 2.20 Aug 26 01:00:59.728972 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Domain-Id: default Aug 26 01:00:59.728972 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Domain-Name: Default Aug 26 01:00:59.728972 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Id: ec39c32378ac4017ad50aa6f930e514b Aug 26 01:00:59.728972 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-700972569 Aug 26 01:00:59.728972 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Role: reader,member Aug 26 01:00:59.728972 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Roles: reader,member Aug 26 01:00:59.730776 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ec39c32378ac4017ad50aa6f930e514b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ec39c32378ac4017ad50aa6f930e514b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ec39c32378ac4017ad50aa6f930e514b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ec39c32378ac4017ad50aa6f930e514b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 01:00:59.730776 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant: tempest-AttachVolumeShelveTestJSON-700972569 Aug 26 01:00:59.730776 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant-Id: ec39c32378ac4017ad50aa6f930e514b Aug 26 01:00:59.730776 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-700972569 Aug 26 01:00:59.730776 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User: tempest-AttachVolumeShelveTestJSON-700972569-project Aug 26 01:00:59.730776 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Domain-Id: default Aug 26 01:00:59.730776 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Domain-Name: Default Aug 26 01:00:59.730776 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Id: 34240c306dc54f0c8758dbb4b4525376 Aug 26 01:00:59.730776 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Name: tempest-AttachVolumeShelveTestJSON-700972569-project Aug 26 01:00:59.730776 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: method: > Aug 26 01:00:59.730776 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: exception: Instance 8af18a63-5c10-4530-9072-6ca92223b8ec could not be found. Aug 26 01:00:59.730776 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: action_args: {'id': '8af18a63-5c10-4530-9072-6ca92223b8ec'} Aug 26 01:00:59.731780 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 01:00:59.731780 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:00:59.731780 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 01:00:59.731780 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 01:00:59.731780 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 01:00:59.731780 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 01:00:59.731780 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 01:00:59.731780 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 01:00:59.731780 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 01:00:59.731780 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 01:00:59.731780 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8af18a63-5c10-4530-9072-6ca92223b8ec could not be found. Aug 26 01:00:59.731780 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:00:59.731780 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:00:59.731780 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:00:59.731780 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:00:59.731780 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:00:59.731780 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:00:59.731780 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 01:00:59.731780 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 01:00:59.731780 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 01:00:59.733320 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 01:00:59.733320 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 01:00:59.733320 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 01:00:59.733320 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 01:00:59.733320 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 01:00:59.733320 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 01:00:59.733320 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 01:00:59.733320 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 01:00:59.733320 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 01:00:59.733320 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8af18a63-5c10-4530-9072-6ca92223b8ec could not be found. Aug 26 01:00:59.733320 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:00:59.733320 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:00:59.733320 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:00:59.733320 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:00:59.733320 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:00:59.733320 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:00:59.733320 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 01:00:59.733320 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 01:00:59.733320 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8af18a63-5c10-4530-9072-6ca92223b8ec could not be found. Aug 26 01:00:59.733320 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:00:59.734844 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-ffca191d-6b8b-4cc1-8f00-a1772f626ff2 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Returning 404 to user: Instance 8af18a63-5c10-4530-9072-6ca92223b8ec could not be found. {{(pid=127564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 01:00:59.734844 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-ffca191d-6b8b-4cc1-8f00-a1772f626ff2 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "DELETE /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 404 len: 111 microversion: 2.20 time: 0.036370 Aug 26 01:00:59.734844 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 422/842] 10.222.0.59 () {60 vars in 1280 bytes} [Fri Aug 26 01:00:59 2022] DELETE /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 26 01:00:59.742521 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-9519d044-50b5-46d3-8ac4-7983e26e5a24 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:00:59.743156 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-9519d044-50b5-46d3-8ac4-7983e26e5a24 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 8af18a63-5c10-4530-9072-6ca92223b8ec] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:00:59.749181 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9519d044-50b5-46d3-8ac4-7983e26e5a24 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:59.749661 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9519d044-50b5-46d3-8ac4-7983e26e5a24 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:59.750093 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9519d044-50b5-46d3-8ac4-7983e26e5a24 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:59.750775 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9519d044-50b5-46d3-8ac4-7983e26e5a24 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:00:59.751218 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9519d044-50b5-46d3-8ac4-7983e26e5a24 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:00:59.752132 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9519d044-50b5-46d3-8ac4-7983e26e5a24 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:00:59.765296 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.wsgi [None req-9519d044-50b5-46d3-8ac4-7983e26e5a24 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] HTTP exception thrown: Instance 8af18a63-5c10-4530-9072-6ca92223b8ec could not be found. Aug 26 01:00:59.766876 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-9519d044-50b5-46d3-8ac4-7983e26e5a24 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Request method failure captured: Aug 26 01:00:59.766876 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: request: GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec HTTP/1.1 Aug 26 01:00:59.766876 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Accept: application/json Aug 26 01:00:59.766876 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Accept-Encoding: identity Aug 26 01:00:59.766876 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Connection: close Aug 26 01:00:59.766876 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Content-Length: 0 Aug 26 01:00:59.766876 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Content-Type: application/json Aug 26 01:00:59.766876 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Host: 10.222.0.59 Aug 26 01:00:59.766876 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Openstack-System-Scope: None Aug 26 01:00:59.766876 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: User-Agent: python-urllib3/1.26.11 Aug 26 01:00:59.766876 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Auth-Token: gAAAAABjCBmgyDDgilWQYDV3Pt1Em3kTCxsE41M0vbwJrr1Rqja-DMZaIcX5WNaG7FxAXeyifEVBYFh6_R904f-XKGQt3qooDi2aWUs0Asz3CfbSPUljnbPhu8WqCIlc-fkFdpvaLdAPObY8uyEVhiLqyDKxGxdz6WKuxtkKvk5v_G0Cg36QQHc Aug 26 01:00:59.766876 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Domain-Id: None Aug 26 01:00:59.766876 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Domain-Name: None Aug 26 01:00:59.766876 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Identity-Status: Confirmed Aug 26 01:00:59.766876 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Is-Admin-Project: True Aug 26 01:00:59.766876 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Openstack-Nova-Api-Version: 2.20 Aug 26 01:00:59.766876 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Domain-Id: default Aug 26 01:00:59.766876 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Domain-Name: Default Aug 26 01:00:59.766876 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Id: ec39c32378ac4017ad50aa6f930e514b Aug 26 01:00:59.766876 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-700972569 Aug 26 01:00:59.766876 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Role: reader,member Aug 26 01:00:59.766876 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Roles: reader,member Aug 26 01:00:59.769188 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ec39c32378ac4017ad50aa6f930e514b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ec39c32378ac4017ad50aa6f930e514b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ec39c32378ac4017ad50aa6f930e514b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ec39c32378ac4017ad50aa6f930e514b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 01:00:59.769188 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant: tempest-AttachVolumeShelveTestJSON-700972569 Aug 26 01:00:59.769188 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant-Id: ec39c32378ac4017ad50aa6f930e514b Aug 26 01:00:59.769188 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-700972569 Aug 26 01:00:59.769188 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User: tempest-AttachVolumeShelveTestJSON-700972569-project Aug 26 01:00:59.769188 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Domain-Id: default Aug 26 01:00:59.769188 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Domain-Name: Default Aug 26 01:00:59.769188 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Id: 34240c306dc54f0c8758dbb4b4525376 Aug 26 01:00:59.769188 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Name: tempest-AttachVolumeShelveTestJSON-700972569-project Aug 26 01:00:59.769188 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: method: > Aug 26 01:00:59.769188 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: exception: Instance 8af18a63-5c10-4530-9072-6ca92223b8ec could not be found. Aug 26 01:00:59.769188 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: action_args: {'id': '8af18a63-5c10-4530-9072-6ca92223b8ec'} Aug 26 01:00:59.770033 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 01:00:59.770033 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:00:59.770033 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 01:00:59.770033 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 01:00:59.770033 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 01:00:59.770033 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 01:00:59.770033 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 01:00:59.770033 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 01:00:59.770033 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 01:00:59.770033 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 01:00:59.770033 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8af18a63-5c10-4530-9072-6ca92223b8ec could not be found. Aug 26 01:00:59.770033 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:00:59.770033 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:00:59.770033 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:00:59.770033 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:00:59.770033 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:00:59.770033 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:00:59.770033 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 01:00:59.770033 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 01:00:59.770033 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 01:00:59.771355 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 01:00:59.771355 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 01:00:59.771355 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 01:00:59.771355 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 01:00:59.771355 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 01:00:59.771355 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 01:00:59.771355 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 01:00:59.771355 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8af18a63-5c10-4530-9072-6ca92223b8ec could not be found. Aug 26 01:00:59.771355 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:00:59.771355 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:00:59.771355 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:00:59.771355 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:00:59.771355 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:00:59.771355 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:00:59.771355 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 01:00:59.771355 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 01:00:59.771355 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8af18a63-5c10-4530-9072-6ca92223b8ec could not be found. Aug 26 01:00:59.771355 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:00:59.772497 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-9519d044-50b5-46d3-8ac4-7983e26e5a24 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Returning 404 to user: Instance 8af18a63-5c10-4530-9072-6ca92223b8ec could not be found. {{(pid=127565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 01:00:59.772497 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-9519d044-50b5-46d3-8ac4-7983e26e5a24 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec" status: 404 len: 111 microversion: 2.20 time: 0.031137 Aug 26 01:00:59.772497 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 421/843] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 01:00:59 2022] GET /compute/v2.1/servers/8af18a63-5c10-4530-9072-6ca92223b8ec => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 26 01:01:01.103642 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-cf32f01b-f77d-4d94-ac9d-419ee702cff0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:01:01.104176 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-cf32f01b-f77d-4d94-ac9d-419ee702cff0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:01:01.110736 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-cf32f01b-f77d-4d94-ac9d-419ee702cff0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:01:01.111789 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-cf32f01b-f77d-4d94-ac9d-419ee702cff0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:01:01.112227 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-cf32f01b-f77d-4d94-ac9d-419ee702cff0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:01:01.112961 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-cf32f01b-f77d-4d94-ac9d-419ee702cff0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:01:01.113415 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-cf32f01b-f77d-4d94-ac9d-419ee702cff0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:01:01.113839 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-cf32f01b-f77d-4d94-ac9d-419ee702cff0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:01:01.127693 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.wsgi [None req-cf32f01b-f77d-4d94-ac9d-419ee702cff0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] HTTP exception thrown: Instance 7502d0cf-4abc-484b-8c85-d8ea6682333b could not be found. Aug 26 01:01:01.129290 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-cf32f01b-f77d-4d94-ac9d-419ee702cff0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Request method failure captured: Aug 26 01:01:01.129290 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: request: DELETE /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b HTTP/1.1 Aug 26 01:01:01.129290 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Accept: application/json Aug 26 01:01:01.129290 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Accept-Encoding: identity Aug 26 01:01:01.129290 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Connection: close Aug 26 01:01:01.129290 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Content-Length: 0 Aug 26 01:01:01.129290 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Content-Type: application/json Aug 26 01:01:01.129290 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Host: 10.222.0.59 Aug 26 01:01:01.129290 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Openstack-System-Scope: None Aug 26 01:01:01.129290 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: User-Agent: python-urllib3/1.26.11 Aug 26 01:01:01.129290 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Auth-Token: gAAAAABjCBmgyDDgilWQYDV3Pt1Em3kTCxsE41M0vbwJrr1Rqja-DMZaIcX5WNaG7FxAXeyifEVBYFh6_R904f-XKGQt3qooDi2aWUs0Asz3CfbSPUljnbPhu8WqCIlc-fkFdpvaLdAPObY8uyEVhiLqyDKxGxdz6WKuxtkKvk5v_G0Cg36QQHc Aug 26 01:01:01.129290 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Domain-Id: None Aug 26 01:01:01.129290 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Domain-Name: None Aug 26 01:01:01.129290 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Identity-Status: Confirmed Aug 26 01:01:01.129290 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Is-Admin-Project: True Aug 26 01:01:01.129290 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Openstack-Nova-Api-Version: 2.20 Aug 26 01:01:01.129290 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Domain-Id: default Aug 26 01:01:01.129290 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Domain-Name: Default Aug 26 01:01:01.129290 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Id: ec39c32378ac4017ad50aa6f930e514b Aug 26 01:01:01.129290 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-700972569 Aug 26 01:01:01.129290 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Role: reader,member Aug 26 01:01:01.129290 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Roles: reader,member Aug 26 01:01:01.131059 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ec39c32378ac4017ad50aa6f930e514b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ec39c32378ac4017ad50aa6f930e514b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ec39c32378ac4017ad50aa6f930e514b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ec39c32378ac4017ad50aa6f930e514b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 01:01:01.131059 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant: tempest-AttachVolumeShelveTestJSON-700972569 Aug 26 01:01:01.131059 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant-Id: ec39c32378ac4017ad50aa6f930e514b Aug 26 01:01:01.131059 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-700972569 Aug 26 01:01:01.131059 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User: tempest-AttachVolumeShelveTestJSON-700972569-project Aug 26 01:01:01.131059 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Domain-Id: default Aug 26 01:01:01.131059 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Domain-Name: Default Aug 26 01:01:01.131059 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Id: 34240c306dc54f0c8758dbb4b4525376 Aug 26 01:01:01.131059 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Name: tempest-AttachVolumeShelveTestJSON-700972569-project Aug 26 01:01:01.131059 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: method: > Aug 26 01:01:01.131059 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: exception: Instance 7502d0cf-4abc-484b-8c85-d8ea6682333b could not be found. Aug 26 01:01:01.131059 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: action_args: {'id': '7502d0cf-4abc-484b-8c85-d8ea6682333b'} Aug 26 01:01:01.131894 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 01:01:01.131894 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:01:01.131894 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 01:01:01.131894 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 01:01:01.131894 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 01:01:01.131894 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 01:01:01.131894 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 01:01:01.131894 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 01:01:01.131894 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 01:01:01.131894 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 01:01:01.131894 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7502d0cf-4abc-484b-8c85-d8ea6682333b could not be found. Aug 26 01:01:01.131894 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:01:01.131894 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:01:01.131894 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:01:01.131894 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:01:01.131894 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:01:01.131894 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:01:01.131894 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 01:01:01.131894 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 01:01:01.131894 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 01:01:01.134131 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 01:01:01.134131 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 01:01:01.134131 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 01:01:01.134131 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 01:01:01.134131 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 01:01:01.134131 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 01:01:01.134131 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 01:01:01.134131 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 01:01:01.134131 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 01:01:01.134131 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7502d0cf-4abc-484b-8c85-d8ea6682333b could not be found. Aug 26 01:01:01.134131 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:01:01.134131 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:01:01.134131 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:01:01.134131 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:01:01.134131 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:01:01.134131 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:01:01.134131 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 01:01:01.134131 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 01:01:01.134131 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7502d0cf-4abc-484b-8c85-d8ea6682333b could not be found. Aug 26 01:01:01.134131 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:01:01.135651 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-cf32f01b-f77d-4d94-ac9d-419ee702cff0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Returning 404 to user: Instance 7502d0cf-4abc-484b-8c85-d8ea6682333b could not be found. {{(pid=127564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 01:01:01.135651 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-cf32f01b-f77d-4d94-ac9d-419ee702cff0 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "DELETE /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 404 len: 111 microversion: 2.20 time: 0.031077 Aug 26 01:01:01.135651 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 423/844] 10.222.0.59 () {60 vars in 1280 bytes} [Fri Aug 26 01:01:01 2022] DELETE /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 26 01:01:01.139523 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-f1524686-f07a-4580-8990-5d17cea279f5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:01:01.140135 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-f1524686-f07a-4580-8990-5d17cea279f5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] [instance: 7502d0cf-4abc-484b-8c85-d8ea6682333b] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:01:01.142874 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:01:01.147833 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f1524686-f07a-4580-8990-5d17cea279f5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:01:01.148450 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f1524686-f07a-4580-8990-5d17cea279f5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:01:01.148952 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f1524686-f07a-4580-8990-5d17cea279f5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:01:01.149680 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f1524686-f07a-4580-8990-5d17cea279f5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:01:01.150129 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f1524686-f07a-4580-8990-5d17cea279f5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:01:01.150556 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f1524686-f07a-4580-8990-5d17cea279f5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:01:01.155390 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:01:01.164903 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.wsgi [None req-f1524686-f07a-4580-8990-5d17cea279f5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] HTTP exception thrown: Instance 7502d0cf-4abc-484b-8c85-d8ea6682333b could not be found. Aug 26 01:01:01.166499 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-f1524686-f07a-4580-8990-5d17cea279f5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Request method failure captured: Aug 26 01:01:01.166499 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: request: GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b HTTP/1.1 Aug 26 01:01:01.166499 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Accept: application/json Aug 26 01:01:01.166499 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Accept-Encoding: identity Aug 26 01:01:01.166499 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Connection: close Aug 26 01:01:01.166499 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Content-Length: 0 Aug 26 01:01:01.166499 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Content-Type: application/json Aug 26 01:01:01.166499 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Host: 10.222.0.59 Aug 26 01:01:01.166499 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Openstack-System-Scope: None Aug 26 01:01:01.166499 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: User-Agent: python-urllib3/1.26.11 Aug 26 01:01:01.166499 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Auth-Token: gAAAAABjCBmgyDDgilWQYDV3Pt1Em3kTCxsE41M0vbwJrr1Rqja-DMZaIcX5WNaG7FxAXeyifEVBYFh6_R904f-XKGQt3qooDi2aWUs0Asz3CfbSPUljnbPhu8WqCIlc-fkFdpvaLdAPObY8uyEVhiLqyDKxGxdz6WKuxtkKvk5v_G0Cg36QQHc Aug 26 01:01:01.166499 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Domain-Id: None Aug 26 01:01:01.166499 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Domain-Name: None Aug 26 01:01:01.166499 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Identity-Status: Confirmed Aug 26 01:01:01.166499 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Is-Admin-Project: True Aug 26 01:01:01.166499 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Openstack-Nova-Api-Version: 2.20 Aug 26 01:01:01.166499 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Domain-Id: default Aug 26 01:01:01.166499 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Domain-Name: Default Aug 26 01:01:01.166499 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Id: ec39c32378ac4017ad50aa6f930e514b Aug 26 01:01:01.166499 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-700972569 Aug 26 01:01:01.166499 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Role: reader,member Aug 26 01:01:01.166499 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Roles: reader,member Aug 26 01:01:01.168316 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ec39c32378ac4017ad50aa6f930e514b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ec39c32378ac4017ad50aa6f930e514b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ec39c32378ac4017ad50aa6f930e514b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ec39c32378ac4017ad50aa6f930e514b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 01:01:01.168316 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant: tempest-AttachVolumeShelveTestJSON-700972569 Aug 26 01:01:01.168316 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant-Id: ec39c32378ac4017ad50aa6f930e514b Aug 26 01:01:01.168316 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-700972569 Aug 26 01:01:01.168316 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User: tempest-AttachVolumeShelveTestJSON-700972569-project Aug 26 01:01:01.168316 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Domain-Id: default Aug 26 01:01:01.168316 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Domain-Name: Default Aug 26 01:01:01.168316 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Id: 34240c306dc54f0c8758dbb4b4525376 Aug 26 01:01:01.168316 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Name: tempest-AttachVolumeShelveTestJSON-700972569-project Aug 26 01:01:01.168316 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: method: > Aug 26 01:01:01.168316 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: exception: Instance 7502d0cf-4abc-484b-8c85-d8ea6682333b could not be found. Aug 26 01:01:01.168316 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: action_args: {'id': '7502d0cf-4abc-484b-8c85-d8ea6682333b'} Aug 26 01:01:01.169408 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 01:01:01.169408 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:01:01.169408 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 01:01:01.169408 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 01:01:01.169408 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 01:01:01.169408 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 01:01:01.169408 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 01:01:01.169408 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 01:01:01.169408 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 01:01:01.169408 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 01:01:01.169408 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7502d0cf-4abc-484b-8c85-d8ea6682333b could not be found. Aug 26 01:01:01.169408 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:01:01.169408 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:01:01.169408 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:01:01.169408 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:01:01.169408 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:01:01.169408 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:01:01.169408 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 01:01:01.169408 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 01:01:01.169408 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 01:01:01.170897 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 01:01:01.170897 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 01:01:01.170897 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 01:01:01.170897 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 01:01:01.170897 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 01:01:01.170897 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 01:01:01.170897 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 01:01:01.170897 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7502d0cf-4abc-484b-8c85-d8ea6682333b could not be found. Aug 26 01:01:01.170897 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:01:01.170897 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:01:01.170897 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:01:01.170897 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:01:01.170897 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:01:01.170897 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:01:01.170897 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 01:01:01.170897 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 01:01:01.170897 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7502d0cf-4abc-484b-8c85-d8ea6682333b could not be found. Aug 26 01:01:01.170897 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:01:01.172383 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-f1524686-f07a-4580-8990-5d17cea279f5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] Returning 404 to user: Instance 7502d0cf-4abc-484b-8c85-d8ea6682333b could not be found. {{(pid=127565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 01:01:01.172383 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-f1524686-f07a-4580-8990-5d17cea279f5 tempest-AttachVolumeShelveTestJSON-700972569 tempest-AttachVolumeShelveTestJSON-700972569-project] 10.222.0.59 "GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b" status: 404 len: 111 microversion: 2.20 time: 0.032279 Aug 26 01:01:01.172383 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 422/845] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Aug 26 01:01:01 2022] GET /compute/v2.1/servers/7502d0cf-4abc-484b-8c85-d8ea6682333b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 26 01:01:02.055733 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-1a3eb742-71eb-43ea-840f-33ac01de217d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2122102260", "imageRef": "ef60327f-6e0c-4f85-8db9-6f6e8968fe9c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "de5adc9b-87c3-4a41-9cca-c473a399648a"}], "security_groups": [{"name": "tempest-securitygroup--1991096213"}], "key_name": "tempest-keypair-1253791505", "user_data": "}} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:01:02.226088 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.network.neutron [None req-1a3eb742-71eb-43ea-840f-33ac01de217d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] validate_networks() for [('de5adc9b-87c3-4a41-9cca-c473a399648a', None, None, None, None, None)] {{(pid=127564) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 01:01:02.925580 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.virt.hardware [None req-1a3eb742-71eb-43ea-840f-33ac01de217d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Flavor limits 0:0:0 {{(pid=127564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 01:01:02.926764 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.virt.hardware [None req-1a3eb742-71eb-43ea-840f-33ac01de217d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Image limits 0:0:0 {{(pid=127564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 01:01:02.927244 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.virt.hardware [None req-1a3eb742-71eb-43ea-840f-33ac01de217d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Flavor pref 0:0:0 {{(pid=127564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 01:01:02.927650 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.virt.hardware [None req-1a3eb742-71eb-43ea-840f-33ac01de217d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Image pref 0:0:0 {{(pid=127564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 01:01:02.928094 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.virt.hardware [None req-1a3eb742-71eb-43ea-840f-33ac01de217d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 01:01:02.937387 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1a3eb742-71eb-43ea-840f-33ac01de217d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:01:02.938697 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1a3eb742-71eb-43ea-840f-33ac01de217d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:01:02.939320 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1a3eb742-71eb-43ea-840f-33ac01de217d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:01:02.942032 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1a3eb742-71eb-43ea-840f-33ac01de217d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:01:02.942032 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1a3eb742-71eb-43ea-840f-33ac01de217d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:01:02.942032 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1a3eb742-71eb-43ea-840f-33ac01de217d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:01:02.958719 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.quota [None req-1a3eb742-71eb-43ea-840f-33ac01de217d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Getting quotas for project 03b021c415a147e08dbfede2ddc8cc27. Resources: {'instances', 'ram', 'cores'} {{(pid=127564) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 01:01:02.963014 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.quota [None req-1a3eb742-71eb-43ea-840f-33ac01de217d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Getting quotas for user 38047508b7d44f05af7116a15ba7e319 and project 03b021c415a147e08dbfede2ddc8cc27. Resources: {'instances', 'ram', 'cores'} {{(pid=127564) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 01:01:02.974602 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-1a3eb742-71eb-43ea-840f-33ac01de217d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Going to run 1 instances... {{(pid=127564) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 01:01:02.976927 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-1a3eb742-71eb-43ea-840f-33ac01de217d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: f432be84-f338-4303-86a0-a45611eb0850] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ef60327f-6e0c-4f85-8db9-6f6e8968fe9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 01:01:03.199233 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-1a3eb742-71eb-43ea-840f-33ac01de217d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.148362 Aug 26 01:01:03.200095 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 424/846] 10.222.0.59 () {60 vars in 1147 bytes} [Fri Aug 26 01:01:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 1150 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 01:01:03.213970 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-6f0e384c-5325-4401-851d-537dce5228c9 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:01:03.215332 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-6f0e384c-5325-4401-851d-537dce5228c9 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: f432be84-f338-4303-86a0-a45611eb0850] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:01:03.336817 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-6f0e384c-5325-4401-851d-537dce5228c9 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38047508b7d44f05af7116a15ba7e319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b021c415a147e08dbfede2ddc8cc27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:01:03.346007 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-6f0e384c-5325-4401-851d-537dce5228c9 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/f432be84-f338-4303-86a0-a45611eb0850" status: 200 len: 1242 microversion: 2.1 time: 0.138365 Aug 26 01:01:03.348851 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 423/847] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:01:03 2022] GET /compute/v2.1/servers/f432be84-f338-4303-86a0-a45611eb0850 => generated 1242 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:01:04.369169 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-8c8f79ea-729c-476a-ae62-eae67ded3dec tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:01:04.369785 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-8c8f79ea-729c-476a-ae62-eae67ded3dec tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: f432be84-f338-4303-86a0-a45611eb0850] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:01:04.379501 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8c8f79ea-729c-476a-ae62-eae67ded3dec tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:01:04.379988 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8c8f79ea-729c-476a-ae62-eae67ded3dec tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:01:04.380418 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8c8f79ea-729c-476a-ae62-eae67ded3dec tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:01:04.381181 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8c8f79ea-729c-476a-ae62-eae67ded3dec tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:01:04.381631 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8c8f79ea-729c-476a-ae62-eae67ded3dec tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:01:04.382053 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8c8f79ea-729c-476a-ae62-eae67ded3dec tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:01:04.486557 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-8c8f79ea-729c-476a-ae62-eae67ded3dec tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38047508b7d44f05af7116a15ba7e319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b021c415a147e08dbfede2ddc8cc27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:01:04.494718 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-8c8f79ea-729c-476a-ae62-eae67ded3dec tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/f432be84-f338-4303-86a0-a45611eb0850" status: 200 len: 1246 microversion: 2.1 time: 0.129452 Aug 26 01:01:04.495291 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 425/848] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:01:04 2022] GET /compute/v2.1/servers/f432be84-f338-4303-86a0-a45611eb0850 => generated 1246 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:01:05.515665 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-d51cdece-545c-47d5-a478-99c17871f2a3 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:01:05.516423 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-d51cdece-545c-47d5-a478-99c17871f2a3 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: f432be84-f338-4303-86a0-a45611eb0850] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:01:05.524194 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d51cdece-545c-47d5-a478-99c17871f2a3 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:01:05.524713 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d51cdece-545c-47d5-a478-99c17871f2a3 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:01:05.525151 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d51cdece-545c-47d5-a478-99c17871f2a3 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:01:05.525845 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d51cdece-545c-47d5-a478-99c17871f2a3 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:01:05.526427 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d51cdece-545c-47d5-a478-99c17871f2a3 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:01:05.526855 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d51cdece-545c-47d5-a478-99c17871f2a3 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:01:05.590979 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-d51cdece-545c-47d5-a478-99c17871f2a3 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38047508b7d44f05af7116a15ba7e319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b021c415a147e08dbfede2ddc8cc27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:01:05.599076 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-d51cdece-545c-47d5-a478-99c17871f2a3 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/f432be84-f338-4303-86a0-a45611eb0850" status: 200 len: 1294 microversion: 2.1 time: 0.087784 Aug 26 01:01:05.599668 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 424/849] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:01:05 2022] GET /compute/v2.1/servers/f432be84-f338-4303-86a0-a45611eb0850 => generated 1294 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 01:01:06.620002 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-c2087c0f-034a-4c6f-8ac9-b3cc44177df9 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:01:06.620646 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-c2087c0f-034a-4c6f-8ac9-b3cc44177df9 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: f432be84-f338-4303-86a0-a45611eb0850] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:01:06.623092 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:01:06.628422 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c2087c0f-034a-4c6f-8ac9-b3cc44177df9 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:01:06.628925 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c2087c0f-034a-4c6f-8ac9-b3cc44177df9 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:01:06.629360 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c2087c0f-034a-4c6f-8ac9-b3cc44177df9 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:01:06.630107 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c2087c0f-034a-4c6f-8ac9-b3cc44177df9 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:01:06.630524 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c2087c0f-034a-4c6f-8ac9-b3cc44177df9 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:01:06.630951 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c2087c0f-034a-4c6f-8ac9-b3cc44177df9 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:01:06.635154 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:01:06.858298 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-c2087c0f-034a-4c6f-8ac9-b3cc44177df9 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38047508b7d44f05af7116a15ba7e319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b021c415a147e08dbfede2ddc8cc27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:01:06.871138 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-c2087c0f-034a-4c6f-8ac9-b3cc44177df9 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/f432be84-f338-4303-86a0-a45611eb0850" status: 200 len: 1368 microversion: 2.1 time: 0.254041 Aug 26 01:01:06.872755 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 426/850] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:01:06 2022] GET /compute/v2.1/servers/f432be84-f338-4303-86a0-a45611eb0850 => generated 1368 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:01:07.894700 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-13a8cae3-8215-4a29-9bb7-52e159ab650d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:01:07.895360 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-13a8cae3-8215-4a29-9bb7-52e159ab650d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: f432be84-f338-4303-86a0-a45611eb0850] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:01:07.903648 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-13a8cae3-8215-4a29-9bb7-52e159ab650d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:01:07.904134 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-13a8cae3-8215-4a29-9bb7-52e159ab650d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:01:07.904600 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-13a8cae3-8215-4a29-9bb7-52e159ab650d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:01:07.905301 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-13a8cae3-8215-4a29-9bb7-52e159ab650d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:01:07.905754 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-13a8cae3-8215-4a29-9bb7-52e159ab650d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:01:07.906183 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-13a8cae3-8215-4a29-9bb7-52e159ab650d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:01:07.995466 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-69d90852-0662-4d9b-89e0-309df0209096 tempest-VolumesGetTestJSON-1033295544 tempest-VolumesGetTestJSON-1033295544-project] Action: 'create', calling method: .version_select at 0x7f8a92d56c10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1069180511", "metadata": {"Type": "work"}}} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:01:08.111345 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-13a8cae3-8215-4a29-9bb7-52e159ab650d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38047508b7d44f05af7116a15ba7e319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b021c415a147e08dbfede2ddc8cc27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:01:08.121813 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-13a8cae3-8215-4a29-9bb7-52e159ab650d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/f432be84-f338-4303-86a0-a45611eb0850" status: 200 len: 1368 microversion: 2.1 time: 0.232019 Aug 26 01:01:08.123716 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 427/851] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:01:07 2022] GET /compute/v2.1/servers/f432be84-f338-4303-86a0-a45611eb0850 => generated 1368 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 01:01:08.136848 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [req-d2afc0a3-c1c4-4507-b553-b85470fbdf1f req-1f3fafaf-9384-4924-8ddb-20a82e1bd845 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f432be84-f338-4303-86a0-a45611eb0850", "tag": "312556d9-9bb5-4bfb-b174-e5a4f1da74ce"}]} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:01:08.159623 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-d2afc0a3-c1c4-4507-b553-b85470fbdf1f req-1f3fafaf-9384-4924-8ddb-20a82e1bd845 service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:01:08.160388 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-d2afc0a3-c1c4-4507-b553-b85470fbdf1f req-1f3fafaf-9384-4924-8ddb-20a82e1bd845 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:01:08.161036 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-d2afc0a3-c1c4-4507-b553-b85470fbdf1f req-1f3fafaf-9384-4924-8ddb-20a82e1bd845 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:01:08.173294 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.compute.server_external_events [req-d2afc0a3-c1c4-4507-b553-b85470fbdf1f req-1f3fafaf-9384-4924-8ddb-20a82e1bd845 service nova] Creating event network-changed:312556d9-9bb5-4bfb-b174-e5a4f1da74ce for instance f432be84-f338-4303-86a0-a45611eb0850 on hv-cinder-83538 Aug 26 01:01:08.178727 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [req-d2afc0a3-c1c4-4507-b553-b85470fbdf1f req-1f3fafaf-9384-4924-8ddb-20a82e1bd845 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053206 Aug 26 01:01:08.179701 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 428/852] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 01:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:01:08.834570 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-69d90852-0662-4d9b-89e0-309df0209096 tempest-VolumesGetTestJSON-1033295544 tempest-VolumesGetTestJSON-1033295544-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.966580 Aug 26 01:01:08.835195 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 425/853] 10.222.0.59 () {60 vars in 1156 bytes} [Fri Aug 26 01:01:07 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 968 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 26 01:01:08.848732 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-e399dd46-7c94-4843-8869-7bfcc3117d81 tempest-VolumesGetTestJSON-1033295544 tempest-VolumesGetTestJSON-1033295544-project] Calling method '.version_select at 0x7f8a96674790>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:01:08.899703 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-e399dd46-7c94-4843-8869-7bfcc3117d81 tempest-VolumesGetTestJSON-1033295544 tempest-VolumesGetTestJSON-1033295544-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/a9d2734b-4b52-4bb1-a8f7-1967a2325e2a" status: 200 len: 353 microversion: 2.1 time: 0.055963 Aug 26 01:01:08.900269 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 429/854] 10.222.0.59 () {58 vars in 1245 bytes} [Fri Aug 26 01:01:08 2022] GET /compute/v2.1/os-volumes/a9d2734b-4b52-4bb1-a8f7-1967a2325e2a => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:01:09.143351 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-50da6924-4d97-4d79-a00f-f645b4e72640 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:01:09.143977 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-50da6924-4d97-4d79-a00f-f645b4e72640 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: f432be84-f338-4303-86a0-a45611eb0850] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:01:09.151390 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-50da6924-4d97-4d79-a00f-f645b4e72640 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:01:09.151881 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-50da6924-4d97-4d79-a00f-f645b4e72640 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:01:09.152320 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-50da6924-4d97-4d79-a00f-f645b4e72640 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:01:09.153094 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-50da6924-4d97-4d79-a00f-f645b4e72640 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:01:09.153546 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-50da6924-4d97-4d79-a00f-f645b4e72640 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:01:09.154092 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-50da6924-4d97-4d79-a00f-f645b4e72640 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:01:09.295769 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-50da6924-4d97-4d79-a00f-f645b4e72640 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38047508b7d44f05af7116a15ba7e319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b021c415a147e08dbfede2ddc8cc27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:01:09.304214 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-50da6924-4d97-4d79-a00f-f645b4e72640 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/f432be84-f338-4303-86a0-a45611eb0850" status: 200 len: 1368 microversion: 2.1 time: 0.165611 Aug 26 01:01:09.304798 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 426/855] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:01:09 2022] GET /compute/v2.1/servers/f432be84-f338-4303-86a0-a45611eb0850 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:01:09.914790 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-9d83044a-d38f-4497-ae3c-4dc36a48e1d2 tempest-VolumesGetTestJSON-1033295544 tempest-VolumesGetTestJSON-1033295544-project] Calling method '.version_select at 0x7f8a96664550>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:01:09.963185 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-9d83044a-d38f-4497-ae3c-4dc36a48e1d2 tempest-VolumesGetTestJSON-1033295544 tempest-VolumesGetTestJSON-1033295544-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/a9d2734b-4b52-4bb1-a8f7-1967a2325e2a" status: 200 len: 354 microversion: 2.1 time: 0.052727 Aug 26 01:01:09.963765 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 430/856] 10.222.0.59 () {58 vars in 1245 bytes} [Fri Aug 26 01:01:09 2022] GET /compute/v2.1/os-volumes/a9d2734b-4b52-4bb1-a8f7-1967a2325e2a => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:01:09.976347 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-ca00a07a-cea4-4b7a-b335-ce2e86d7ada1 tempest-VolumesGetTestJSON-1033295544 tempest-VolumesGetTestJSON-1033295544-project] Calling method '.version_select at 0x7f8a92cb9820>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:01:10.022287 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-ca00a07a-cea4-4b7a-b335-ce2e86d7ada1 tempest-VolumesGetTestJSON-1033295544 tempest-VolumesGetTestJSON-1033295544-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/a9d2734b-4b52-4bb1-a8f7-1967a2325e2a" status: 200 len: 354 microversion: 2.1 time: 0.049430 Aug 26 01:01:10.022846 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 427/857] 10.222.0.59 () {58 vars in 1245 bytes} [Fri Aug 26 01:01:09 2022] GET /compute/v2.1/os-volumes/a9d2734b-4b52-4bb1-a8f7-1967a2325e2a => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:01:10.041221 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-d005c035-198b-43df-9ff5-88f4d2726dda tempest-VolumesGetTestJSON-1033295544 tempest-VolumesGetTestJSON-1033295544-project] Calling method '.version_select at 0x7f8a9666f670>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:01:10.325151 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-39a4fb69-f354-4235-8ecd-faf7b3fb1566 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:01:10.337992 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-39a4fb69-f354-4235-8ecd-faf7b3fb1566 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: f432be84-f338-4303-86a0-a45611eb0850] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:01:10.337992 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-39a4fb69-f354-4235-8ecd-faf7b3fb1566 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:01:10.337992 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-39a4fb69-f354-4235-8ecd-faf7b3fb1566 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:01:10.337992 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-39a4fb69-f354-4235-8ecd-faf7b3fb1566 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:01:10.338399 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-39a4fb69-f354-4235-8ecd-faf7b3fb1566 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:01:10.338399 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-39a4fb69-f354-4235-8ecd-faf7b3fb1566 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:01:10.338399 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-39a4fb69-f354-4235-8ecd-faf7b3fb1566 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:01:10.384325 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-d005c035-198b-43df-9ff5-88f4d2726dda tempest-VolumesGetTestJSON-1033295544 tempest-VolumesGetTestJSON-1033295544-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/a9d2734b-4b52-4bb1-a8f7-1967a2325e2a" status: 202 len: 0 microversion: 2.1 time: 0.342691 Aug 26 01:01:10.384325 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 431/858] 10.222.0.59 () {58 vars in 1248 bytes} [Fri Aug 26 01:01:10 2022] DELETE /compute/v2.1/os-volumes/a9d2734b-4b52-4bb1-a8f7-1967a2325e2a => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 01:01:10.388466 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-f8c25705-e71c-4d3b-aadb-cc9e46a6fd19 tempest-VolumesGetTestJSON-1033295544 tempest-VolumesGetTestJSON-1033295544-project] Calling method '.version_select at 0x7f8a9666f430>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:01:10.436836 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-f8c25705-e71c-4d3b-aadb-cc9e46a6fd19 tempest-VolumesGetTestJSON-1033295544 tempest-VolumesGetTestJSON-1033295544-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/a9d2734b-4b52-4bb1-a8f7-1967a2325e2a" status: 200 len: 353 microversion: 2.1 time: 0.052052 Aug 26 01:01:10.437421 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 432/859] 10.222.0.59 () {58 vars in 1245 bytes} [Fri Aug 26 01:01:10 2022] GET /compute/v2.1/os-volumes/a9d2734b-4b52-4bb1-a8f7-1967a2325e2a => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 01:01:10.471606 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-39a4fb69-f354-4235-8ecd-faf7b3fb1566 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38047508b7d44f05af7116a15ba7e319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b021c415a147e08dbfede2ddc8cc27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:01:10.479207 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-39a4fb69-f354-4235-8ecd-faf7b3fb1566 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/f432be84-f338-4303-86a0-a45611eb0850" status: 200 len: 1368 microversion: 2.1 time: 0.158351 Aug 26 01:01:10.479780 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 428/860] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:01:10 2022] GET /compute/v2.1/servers/f432be84-f338-4303-86a0-a45611eb0850 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 01:01:11.450769 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-6325e334-b18b-4e16-8d5b-62b600232c16 tempest-VolumesGetTestJSON-1033295544 tempest-VolumesGetTestJSON-1033295544-project] Calling method '.version_select at 0x7f8a96674c10>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:01:11.478781 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.wsgi [None req-6325e334-b18b-4e16-8d5b-62b600232c16 tempest-VolumesGetTestJSON-1033295544 tempest-VolumesGetTestJSON-1033295544-project] HTTP exception thrown: Volume a9d2734b-4b52-4bb1-a8f7-1967a2325e2a could not be found. Aug 26 01:01:11.480875 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-6325e334-b18b-4e16-8d5b-62b600232c16 tempest-VolumesGetTestJSON-1033295544 tempest-VolumesGetTestJSON-1033295544-project] Request method failure captured: Aug 26 01:01:11.480875 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: request: GET /compute/v2.1/os-volumes/a9d2734b-4b52-4bb1-a8f7-1967a2325e2a HTTP/1.1 Aug 26 01:01:11.480875 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Accept: application/json Aug 26 01:01:11.480875 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Accept-Encoding: identity Aug 26 01:01:11.480875 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Connection: close Aug 26 01:01:11.480875 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Content-Length: 0 Aug 26 01:01:11.480875 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Content-Type: application/json Aug 26 01:01:11.480875 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Host: 10.222.0.59 Aug 26 01:01:11.480875 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Openstack-System-Scope: None Aug 26 01:01:11.480875 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: User-Agent: python-urllib3/1.26.11 Aug 26 01:01:11.480875 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Auth-Token: gAAAAABjCBtTDsu5Nem75BwNAwRw7c693yDOj4UcEE57JPqslBbTmWVaLMDX705O-1pXCeufmNKDpllu3ew0YCNXEwwiIdZ_lBWBMPPbe3Z1C-fqL-xNCyG9Hc-or88ZTufga-jxrDN618Z6PmHBw2lvZwCXidX5Gf9CICn_O0wMzF214Nx4u2Y Aug 26 01:01:11.480875 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Domain-Id: None Aug 26 01:01:11.480875 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Domain-Name: None Aug 26 01:01:11.480875 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Identity-Status: Confirmed Aug 26 01:01:11.480875 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Is-Admin-Project: True Aug 26 01:01:11.480875 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Domain-Id: default Aug 26 01:01:11.480875 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Domain-Name: Default Aug 26 01:01:11.480875 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Id: e77b9e003c4643898c8c6cf6d90c7184 Aug 26 01:01:11.480875 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Name: tempest-VolumesGetTestJSON-1033295544 Aug 26 01:01:11.480875 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Role: reader,member Aug 26 01:01:11.480875 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Roles: reader,member Aug 26 01:01:11.482544 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e77b9e003c4643898c8c6cf6d90c7184"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e77b9e003c4643898c8c6cf6d90c7184"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e77b9e003c4643898c8c6cf6d90c7184"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e77b9e003c4643898c8c6cf6d90c7184"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 01:01:11.482544 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant: tempest-VolumesGetTestJSON-1033295544 Aug 26 01:01:11.482544 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant-Id: e77b9e003c4643898c8c6cf6d90c7184 Aug 26 01:01:11.482544 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant-Name: tempest-VolumesGetTestJSON-1033295544 Aug 26 01:01:11.482544 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User: tempest-VolumesGetTestJSON-1033295544-project Aug 26 01:01:11.482544 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Domain-Id: default Aug 26 01:01:11.482544 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Domain-Name: Default Aug 26 01:01:11.482544 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Id: 4304cf34878d454892e639874d365560 Aug 26 01:01:11.482544 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Name: tempest-VolumesGetTestJSON-1033295544-project Aug 26 01:01:11.482544 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: method: Aug 26 01:01:11.482544 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: exception: Volume a9d2734b-4b52-4bb1-a8f7-1967a2325e2a could not be found. Aug 26 01:01:11.482544 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: action_args: {'id': 'a9d2734b-4b52-4bb1-a8f7-1967a2325e2a'} Aug 26 01:01:11.482544 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 01:01:11.483607 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:01:11.483607 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 01:01:11.483607 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 01:01:11.483607 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 26 01:01:11.483607 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 26 01:01:11.483607 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 26 01:01:11.483607 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 26 01:01:11.483607 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 01:01:11.483607 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 01:01:11.483607 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 01:01:11.483607 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 01:01:11.483607 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 01:01:11.483607 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 01:01:11.483607 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 01:01:11.483607 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 01:01:11.483607 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a9d2734b-4b52-4bb1-a8f7-1967a2325e2a could not be found. (HTTP 404) (Request-ID: req-3eef7be3-4ccc-42c7-8576-9406b931c08c) Aug 26 01:01:11.483607 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:01:11.483607 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:01:11.483607 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:01:11.485150 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:01:11.485150 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 26 01:01:11.485150 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 26 01:01:11.485150 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 26 01:01:11.485150 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 26 01:01:11.485150 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 26 01:01:11.485150 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 26 01:01:11.485150 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 26 01:01:11.485150 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 26 01:01:11.485150 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 01:01:11.485150 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 01:01:11.485150 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 26 01:01:11.485150 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 26 01:01:11.485150 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 26 01:01:11.485150 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 26 01:01:11.485150 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 01:01:11.485150 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 01:01:11.485150 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 01:01:11.485150 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 01:01:11.486970 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 01:01:11.486970 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 01:01:11.486970 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 01:01:11.486970 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 01:01:11.486970 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a9d2734b-4b52-4bb1-a8f7-1967a2325e2a could not be found. Aug 26 01:01:11.486970 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:01:11.486970 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:01:11.486970 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:01:11.486970 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:01:11.486970 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:01:11.486970 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:01:11.486970 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 01:01:11.486970 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 01:01:11.486970 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 01:01:11.486970 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 01:01:11.486970 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 01:01:11.486970 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 01:01:11.486970 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 26 01:01:11.486970 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 01:01:11.488394 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a9d2734b-4b52-4bb1-a8f7-1967a2325e2a could not be found. Aug 26 01:01:11.488394 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:01:11.488394 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:01:11.488394 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:01:11.488394 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:01:11.488394 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:01:11.488394 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:01:11.488394 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 01:01:11.488394 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 01:01:11.488394 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a9d2734b-4b52-4bb1-a8f7-1967a2325e2a could not be found. Aug 26 01:01:11.488394 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:01:11.488394 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-6325e334-b18b-4e16-8d5b-62b600232c16 tempest-VolumesGetTestJSON-1033295544 tempest-VolumesGetTestJSON-1033295544-project] Returning 404 to user: Volume a9d2734b-4b52-4bb1-a8f7-1967a2325e2a could not be found. {{(pid=127564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 01:01:11.488394 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-6325e334-b18b-4e16-8d5b-62b600232c16 tempest-VolumesGetTestJSON-1033295544 tempest-VolumesGetTestJSON-1033295544-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/a9d2734b-4b52-4bb1-a8f7-1967a2325e2a" status: 404 len: 109 microversion: 2.1 time: 0.035866 Aug 26 01:01:11.488394 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 433/861] 10.222.0.59 () {58 vars in 1245 bytes} [Fri Aug 26 01:01:11 2022] GET /compute/v2.1/os-volumes/a9d2734b-4b52-4bb1-a8f7-1967a2325e2a => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 01:01:11.500797 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-fcf1d8ff-abc8-4ad0-8df5-4e79f938b86c tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:01:11.501942 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-fcf1d8ff-abc8-4ad0-8df5-4e79f938b86c tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: f432be84-f338-4303-86a0-a45611eb0850] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:01:11.508330 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-fcf1d8ff-abc8-4ad0-8df5-4e79f938b86c tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:01:11.508841 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-fcf1d8ff-abc8-4ad0-8df5-4e79f938b86c tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:01:11.509279 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-fcf1d8ff-abc8-4ad0-8df5-4e79f938b86c tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:01:11.509974 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-fcf1d8ff-abc8-4ad0-8df5-4e79f938b86c tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:01:11.510421 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-fcf1d8ff-abc8-4ad0-8df5-4e79f938b86c tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:01:11.510842 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-fcf1d8ff-abc8-4ad0-8df5-4e79f938b86c tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:01:11.642106 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-fcf1d8ff-abc8-4ad0-8df5-4e79f938b86c tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38047508b7d44f05af7116a15ba7e319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b021c415a147e08dbfede2ddc8cc27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:01:11.650022 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-fcf1d8ff-abc8-4ad0-8df5-4e79f938b86c tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/f432be84-f338-4303-86a0-a45611eb0850" status: 200 len: 1368 microversion: 2.1 time: 0.152993 Aug 26 01:01:11.650574 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 429/862] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:01:11 2022] GET /compute/v2.1/servers/f432be84-f338-4303-86a0-a45611eb0850 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:01:12.671945 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-46581a0d-60ce-4900-a6f7-3591b2232b24 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:01:12.672830 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-46581a0d-60ce-4900-a6f7-3591b2232b24 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: f432be84-f338-4303-86a0-a45611eb0850] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:01:12.678915 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-46581a0d-60ce-4900-a6f7-3591b2232b24 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:01:12.679492 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-46581a0d-60ce-4900-a6f7-3591b2232b24 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:01:12.679931 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-46581a0d-60ce-4900-a6f7-3591b2232b24 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:01:12.680647 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-46581a0d-60ce-4900-a6f7-3591b2232b24 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:01:12.681098 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-46581a0d-60ce-4900-a6f7-3591b2232b24 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:01:12.681523 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-46581a0d-60ce-4900-a6f7-3591b2232b24 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:01:12.822285 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-46581a0d-60ce-4900-a6f7-3591b2232b24 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38047508b7d44f05af7116a15ba7e319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b021c415a147e08dbfede2ddc8cc27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:01:12.826735 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-46581a0d-60ce-4900-a6f7-3591b2232b24 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/f432be84-f338-4303-86a0-a45611eb0850" status: 200 len: 1368 microversion: 2.1 time: 0.159559 Aug 26 01:01:12.827300 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 434/863] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:01:12 2022] GET /compute/v2.1/servers/f432be84-f338-4303-86a0-a45611eb0850 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:01:12.879537 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [req-a9214408-78d9-4673-a034-10e0d51cb5c3 req-d9cb968e-a12e-424a-8691-3f3824cd8147 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f432be84-f338-4303-86a0-a45611eb0850", "name": "network-vif-plugged", "status": "completed", "tag": "312556d9-9bb5-4bfb-b174-e5a4f1da74ce"}]} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:01:12.892342 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-a9214408-78d9-4673-a034-10e0d51cb5c3 req-d9cb968e-a12e-424a-8691-3f3824cd8147 service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:01:12.892342 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-a9214408-78d9-4673-a034-10e0d51cb5c3 req-d9cb968e-a12e-424a-8691-3f3824cd8147 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:01:12.892729 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-a9214408-78d9-4673-a034-10e0d51cb5c3 req-d9cb968e-a12e-424a-8691-3f3824cd8147 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:01:12.903997 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.compute.server_external_events [req-a9214408-78d9-4673-a034-10e0d51cb5c3 req-d9cb968e-a12e-424a-8691-3f3824cd8147 service nova] Creating event network-vif-plugged:312556d9-9bb5-4bfb-b174-e5a4f1da74ce for instance f432be84-f338-4303-86a0-a45611eb0850 on hv-cinder-83538 Aug 26 01:01:12.909121 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [req-a9214408-78d9-4673-a034-10e0d51cb5c3 req-d9cb968e-a12e-424a-8691-3f3824cd8147 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033746 Aug 26 01:01:12.909713 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 430/864] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 01:01:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:01:13.847754 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-66b39a65-72d9-49b2-bd99-cc2a6aa0bb80 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:01:13.848368 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-66b39a65-72d9-49b2-bd99-cc2a6aa0bb80 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: f432be84-f338-4303-86a0-a45611eb0850] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:01:13.850485 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell0:SELECT=2 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:01:13.851162 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell0:SELECT=6 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:01:13.856495 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-66b39a65-72d9-49b2-bd99-cc2a6aa0bb80 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:01:13.863410 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-66b39a65-72d9-49b2-bd99-cc2a6aa0bb80 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:01:13.863410 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-66b39a65-72d9-49b2-bd99-cc2a6aa0bb80 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:01:13.863410 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-66b39a65-72d9-49b2-bd99-cc2a6aa0bb80 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:01:13.863410 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-66b39a65-72d9-49b2-bd99-cc2a6aa0bb80 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:01:13.863817 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-66b39a65-72d9-49b2-bd99-cc2a6aa0bb80 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:01:13.984629 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-66b39a65-72d9-49b2-bd99-cc2a6aa0bb80 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38047508b7d44f05af7116a15ba7e319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b021c415a147e08dbfede2ddc8cc27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:01:13.993236 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-66b39a65-72d9-49b2-bd99-cc2a6aa0bb80 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/f432be84-f338-4303-86a0-a45611eb0850" status: 200 len: 1368 microversion: 2.1 time: 0.149255 Aug 26 01:01:13.993802 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 435/865] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:01:13 2022] GET /compute/v2.1/servers/f432be84-f338-4303-86a0-a45611eb0850 => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:01:15.014827 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-c9d82724-c147-48a5-bc66-c8bf53904607 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:01:15.015537 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-c9d82724-c147-48a5-bc66-c8bf53904607 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: f432be84-f338-4303-86a0-a45611eb0850] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:01:15.017543 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell0:SELECT=6 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:01:15.022896 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c9d82724-c147-48a5-bc66-c8bf53904607 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:01:15.023370 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c9d82724-c147-48a5-bc66-c8bf53904607 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:01:15.023804 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c9d82724-c147-48a5-bc66-c8bf53904607 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:01:15.024509 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c9d82724-c147-48a5-bc66-c8bf53904607 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:01:15.024963 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c9d82724-c147-48a5-bc66-c8bf53904607 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:01:15.025388 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c9d82724-c147-48a5-bc66-c8bf53904607 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:01:15.170492 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-c9d82724-c147-48a5-bc66-c8bf53904607 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38047508b7d44f05af7116a15ba7e319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b021c415a147e08dbfede2ddc8cc27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:01:15.178978 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-c9d82724-c147-48a5-bc66-c8bf53904607 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/f432be84-f338-4303-86a0-a45611eb0850" status: 200 len: 1368 microversion: 2.1 time: 0.168239 Aug 26 01:01:15.179539 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 431/866] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:01:15 2022] GET /compute/v2.1/servers/f432be84-f338-4303-86a0-a45611eb0850 => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:01:16.199697 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-e7bf53dd-7650-48dc-ad21-85c9c3309161 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:01:16.200304 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-e7bf53dd-7650-48dc-ad21-85c9c3309161 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: f432be84-f338-4303-86a0-a45611eb0850] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:01:16.207490 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e7bf53dd-7650-48dc-ad21-85c9c3309161 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:01:16.207910 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e7bf53dd-7650-48dc-ad21-85c9c3309161 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:01:16.208613 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e7bf53dd-7650-48dc-ad21-85c9c3309161 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:01:16.209661 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e7bf53dd-7650-48dc-ad21-85c9c3309161 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:01:16.210349 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e7bf53dd-7650-48dc-ad21-85c9c3309161 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:01:16.210994 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e7bf53dd-7650-48dc-ad21-85c9c3309161 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:01:16.350462 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-e7bf53dd-7650-48dc-ad21-85c9c3309161 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38047508b7d44f05af7116a15ba7e319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b021c415a147e08dbfede2ddc8cc27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:01:16.358614 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-e7bf53dd-7650-48dc-ad21-85c9c3309161 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/f432be84-f338-4303-86a0-a45611eb0850" status: 200 len: 1559 microversion: 2.1 time: 0.163355 Aug 26 01:01:16.359623 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 436/867] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:01:16 2022] GET /compute/v2.1/servers/f432be84-f338-4303-86a0-a45611eb0850 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:01:16.379516 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-992ba33c-5c8c-4ca0-88d1-e0a97154415a tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:01:16.380060 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-992ba33c-5c8c-4ca0-88d1-e0a97154415a tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: f432be84-f338-4303-86a0-a45611eb0850] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:01:16.386397 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-992ba33c-5c8c-4ca0-88d1-e0a97154415a tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:01:16.386883 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-992ba33c-5c8c-4ca0-88d1-e0a97154415a tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:01:16.387318 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-992ba33c-5c8c-4ca0-88d1-e0a97154415a tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:01:16.388009 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-992ba33c-5c8c-4ca0-88d1-e0a97154415a tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:01:16.388466 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-992ba33c-5c8c-4ca0-88d1-e0a97154415a tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:01:16.392264 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-992ba33c-5c8c-4ca0-88d1-e0a97154415a tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:01:16.478858 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-992ba33c-5c8c-4ca0-88d1-e0a97154415a tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/f432be84-f338-4303-86a0-a45611eb0850/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103599 Aug 26 01:01:16.479433 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 432/868] 10.222.0.59 () {58 vars in 1275 bytes} [Fri Aug 26 01:01:16 2022] GET /compute/v2.1/servers/f432be84-f338-4303-86a0-a45611eb0850/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:01:17.538145 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [req-263d6e4d-f2c8-4961-a430-18a7a63705f3 req-65c216c9-c2f0-49ad-8f2c-109d3d7b5005 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f432be84-f338-4303-86a0-a45611eb0850", "tag": "312556d9-9bb5-4bfb-b174-e5a4f1da74ce"}]} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:01:17.552970 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-263d6e4d-f2c8-4961-a430-18a7a63705f3 req-65c216c9-c2f0-49ad-8f2c-109d3d7b5005 service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:01:17.553769 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-263d6e4d-f2c8-4961-a430-18a7a63705f3 req-65c216c9-c2f0-49ad-8f2c-109d3d7b5005 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:01:17.554453 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-263d6e4d-f2c8-4961-a430-18a7a63705f3 req-65c216c9-c2f0-49ad-8f2c-109d3d7b5005 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:01:17.567879 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.compute.server_external_events [req-263d6e4d-f2c8-4961-a430-18a7a63705f3 req-65c216c9-c2f0-49ad-8f2c-109d3d7b5005 service nova] Creating event network-changed:312556d9-9bb5-4bfb-b174-e5a4f1da74ce for instance f432be84-f338-4303-86a0-a45611eb0850 on hv-cinder-83538 Aug 26 01:01:17.573182 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [req-263d6e4d-f2c8-4961-a430-18a7a63705f3 req-65c216c9-c2f0-49ad-8f2c-109d3d7b5005 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041542 Aug 26 01:01:17.574560 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 437/869] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 01:01:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:01:53.621765 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_api:SELECT=19 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:01:53.622522 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell1:SELECT=37 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:01:53.626483 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-dc88fa95-3e92-4a29-9997-e9ee146df5f0 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1351552193", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1867992654", "security_groups": [{"name": "tempest-secgroup-smoke-1310762645"}], "block_device_mapping_v2": [{"uuid": "f1cdf5d6-5fc3-4cb1-a6dd-7ae0dbe74eb4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "67cce745-2ab6-4c41-99b3-cb2978e1bfd5"}]}} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:01:53.742331 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.network.neutron [None req-dc88fa95-3e92-4a29-9997-e9ee146df5f0 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] validate_networks() for [('67cce745-2ab6-4c41-99b3-cb2978e1bfd5', None, None, None, None, None)] {{(pid=127565) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 01:01:54.123219 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.virt.hardware [None req-dc88fa95-3e92-4a29-9997-e9ee146df5f0 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Flavor limits 0:0:0 {{(pid=127565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 01:01:54.123638 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.virt.hardware [None req-dc88fa95-3e92-4a29-9997-e9ee146df5f0 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Image limits 0:0:0 {{(pid=127565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 01:01:54.124693 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.virt.hardware [None req-dc88fa95-3e92-4a29-9997-e9ee146df5f0 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Flavor pref 0:0:0 {{(pid=127565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 01:01:54.125101 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.virt.hardware [None req-dc88fa95-3e92-4a29-9997-e9ee146df5f0 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Image pref 0:0:0 {{(pid=127565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 01:01:54.125508 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.virt.hardware [None req-dc88fa95-3e92-4a29-9997-e9ee146df5f0 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 01:01:54.134233 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-dc88fa95-3e92-4a29-9997-e9ee146df5f0 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:01:54.134708 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-dc88fa95-3e92-4a29-9997-e9ee146df5f0 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:01:54.135210 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-dc88fa95-3e92-4a29-9997-e9ee146df5f0 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:01:54.135929 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-dc88fa95-3e92-4a29-9997-e9ee146df5f0 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:01:54.136374 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-dc88fa95-3e92-4a29-9997-e9ee146df5f0 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:01:54.136817 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-dc88fa95-3e92-4a29-9997-e9ee146df5f0 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:01:54.155992 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.quota [None req-dc88fa95-3e92-4a29-9997-e9ee146df5f0 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Getting quotas for project ca3e24d51bdf44c5ad7219fa57d3d23b. Resources: {'instances', 'ram', 'cores'} {{(pid=127565) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 01:01:54.160379 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.quota [None req-dc88fa95-3e92-4a29-9997-e9ee146df5f0 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Getting quotas for user cd45f1813efc4926a30454aaa108ac47 and project ca3e24d51bdf44c5ad7219fa57d3d23b. Resources: {'instances', 'ram', 'cores'} {{(pid=127565) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 01:01:54.218861 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-dc88fa95-3e92-4a29-9997-e9ee146df5f0 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Going to run 1 instances... {{(pid=127565) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 01:01:54.220978 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-dc88fa95-3e92-4a29-9997-e9ee146df5f0 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: 31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f1cdf5d6-5fc3-4cb1-a6dd-7ae0dbe74eb4',volume_size=None,volume_type=None)] {{(pid=127565) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 01:01:54.495792 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-845aea8e-2cb9-4a10-8172-b26a87990437 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:01:54.496444 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-845aea8e-2cb9-4a10-8172-b26a87990437 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: f432be84-f338-4303-86a0-a45611eb0850] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:01:54.498514 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_api:SELECT=13 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:01:54.499191 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell1:SELECT=33 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:01:54.504346 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-845aea8e-2cb9-4a10-8172-b26a87990437 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:01:54.504910 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-845aea8e-2cb9-4a10-8172-b26a87990437 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:01:54.505351 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-845aea8e-2cb9-4a10-8172-b26a87990437 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:01:54.506045 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-845aea8e-2cb9-4a10-8172-b26a87990437 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:01:54.506504 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-845aea8e-2cb9-4a10-8172-b26a87990437 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:01:54.506929 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-845aea8e-2cb9-4a10-8172-b26a87990437 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:01:54.531806 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-845aea8e-2cb9-4a10-8172-b26a87990437 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/f432be84-f338-4303-86a0-a45611eb0850/ips" status: 200 len: 150 microversion: 2.1 time: 0.040383 Aug 26 01:01:54.532380 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 438/870] 10.222.0.59 () {58 vars in 1248 bytes} [Fri Aug 26 01:01:54 2022] GET /compute/v2.1/servers/f432be84-f338-4303-86a0-a45611eb0850/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 01:01:54.685494 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-dc88fa95-3e92-4a29-9997-e9ee146df5f0 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.065080 Aug 26 01:01:54.686429 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 433/871] 10.222.0.59 () {60 vars in 1147 bytes} [Fri Aug 26 01:01:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 1067 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 01:01:54.710544 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-527e1e61-3536-4d1d-a937-043317b0ade4 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:01:54.710544 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-527e1e61-3536-4d1d-a937-043317b0ade4 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: 31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:01:54.762673 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-527e1e61-3536-4d1d-a937-043317b0ade4 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:01:54.793121 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-527e1e61-3536-4d1d-a937-043317b0ade4 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed" status: 200 len: 1095 microversion: 2.1 time: 0.099397 Aug 26 01:01:54.793709 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 439/872] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:01:54 2022] GET /compute/v2.1/servers/31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed => generated 1095 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:01:55.813880 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-2ccd0be2-b50b-4b5a-973e-b2d087b552db tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:01:55.814493 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-2ccd0be2-b50b-4b5a-973e-b2d087b552db tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: 31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:01:55.831255 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2ccd0be2-b50b-4b5a-973e-b2d087b552db tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:01:55.832055 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2ccd0be2-b50b-4b5a-973e-b2d087b552db tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:01:55.833006 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2ccd0be2-b50b-4b5a-973e-b2d087b552db tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:01:55.834361 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2ccd0be2-b50b-4b5a-973e-b2d087b552db tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:01:55.835403 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2ccd0be2-b50b-4b5a-973e-b2d087b552db tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:01:55.835888 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2ccd0be2-b50b-4b5a-973e-b2d087b552db tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:01:55.914746 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-2ccd0be2-b50b-4b5a-973e-b2d087b552db tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:01:55.926498 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-2ccd0be2-b50b-4b5a-973e-b2d087b552db tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed" status: 200 len: 1145 microversion: 2.1 time: 0.114354 Aug 26 01:01:55.927951 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 434/873] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:01:55 2022] GET /compute/v2.1/servers/31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed => generated 1145 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:01:56.596075 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-f908a279-f9f1-4277-b697-cba2943b3857 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f6116700-aeb2-4fc5-909a-d95b9b4ea02d"}} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:01:56.598494 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-f908a279-f9f1-4277-b697-cba2943b3857 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: f432be84-f338-4303-86a0-a45611eb0850] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:01:56.607056 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f908a279-f9f1-4277-b697-cba2943b3857 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:01:56.607644 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f908a279-f9f1-4277-b697-cba2943b3857 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:01:56.608089 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f908a279-f9f1-4277-b697-cba2943b3857 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:01:56.608902 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f908a279-f9f1-4277-b697-cba2943b3857 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:01:56.609376 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f908a279-f9f1-4277-b697-cba2943b3857 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:01:56.609806 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f908a279-f9f1-4277-b697-cba2943b3857 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:01:56.950316 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-87599fb0-c99a-4e25-85c9-961fe38e8f7d tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:01:56.950933 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-87599fb0-c99a-4e25-85c9-961fe38e8f7d tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: 31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:01:56.959196 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-87599fb0-c99a-4e25-85c9-961fe38e8f7d tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:01:56.961063 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-87599fb0-c99a-4e25-85c9-961fe38e8f7d tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:01:56.961836 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-87599fb0-c99a-4e25-85c9-961fe38e8f7d tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:01:56.962799 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-87599fb0-c99a-4e25-85c9-961fe38e8f7d tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:01:56.963418 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-87599fb0-c99a-4e25-85c9-961fe38e8f7d tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:01:56.964048 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-87599fb0-c99a-4e25-85c9-961fe38e8f7d tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:01:57.050627 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-87599fb0-c99a-4e25-85c9-961fe38e8f7d tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:01:57.060113 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-87599fb0-c99a-4e25-85c9-961fe38e8f7d tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed" status: 200 len: 1193 microversion: 2.1 time: 0.114177 Aug 26 01:01:57.061218 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 435/874] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:01:56 2022] GET /compute/v2.1/servers/31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed => generated 1193 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 01:01:57.617314 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-f908a279-f9f1-4277-b697-cba2943b3857 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "POST /compute/v2.1/servers/f432be84-f338-4303-86a0-a45611eb0850/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.025281 Aug 26 01:01:57.632491 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 440/875] 10.222.0.59 () {60 vars in 1323 bytes} [Fri Aug 26 01:01:56 2022] POST /compute/v2.1/servers/f432be84-f338-4303-86a0-a45611eb0850/os-volume_attachments => generated 194 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 01:01:58.086923 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-113feaa0-9d5e-487c-8f60-8606cad5c472 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:01:58.087697 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-113feaa0-9d5e-487c-8f60-8606cad5c472 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: 31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:01:58.095431 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-113feaa0-9d5e-487c-8f60-8606cad5c472 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:01:58.096112 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-113feaa0-9d5e-487c-8f60-8606cad5c472 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:01:58.096695 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-113feaa0-9d5e-487c-8f60-8606cad5c472 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:01:58.097501 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-113feaa0-9d5e-487c-8f60-8606cad5c472 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:01:58.098190 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-113feaa0-9d5e-487c-8f60-8606cad5c472 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:01:58.098825 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-113feaa0-9d5e-487c-8f60-8606cad5c472 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:01:58.174660 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-113feaa0-9d5e-487c-8f60-8606cad5c472 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:01:58.183386 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-113feaa0-9d5e-487c-8f60-8606cad5c472 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed" status: 200 len: 1211 microversion: 2.1 time: 0.100769 Aug 26 01:01:58.183963 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 436/876] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:01:58 2022] GET /compute/v2.1/servers/31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed => generated 1211 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:01:59.210786 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-3584f084-f2b2-4462-b8bf-dedc3f02a99c tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:01:59.212088 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-3584f084-f2b2-4462-b8bf-dedc3f02a99c tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: 31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:01:59.219630 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3584f084-f2b2-4462-b8bf-dedc3f02a99c tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:01:59.220392 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3584f084-f2b2-4462-b8bf-dedc3f02a99c tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:01:59.221066 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3584f084-f2b2-4462-b8bf-dedc3f02a99c tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:01:59.221937 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3584f084-f2b2-4462-b8bf-dedc3f02a99c tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:01:59.222753 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3584f084-f2b2-4462-b8bf-dedc3f02a99c tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:01:59.223521 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3584f084-f2b2-4462-b8bf-dedc3f02a99c tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:01:59.534571 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-3584f084-f2b2-4462-b8bf-dedc3f02a99c tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:01:59.542730 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-3584f084-f2b2-4462-b8bf-dedc3f02a99c tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed" status: 200 len: 1279 microversion: 2.1 time: 0.340902 Aug 26 01:01:59.543568 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 441/877] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:01:59 2022] GET /compute/v2.1/servers/31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed => generated 1279 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:02:00.563372 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-eb669d31-e85f-4e5d-bfe2-3421a7fe2fe5 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:02:00.564154 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-eb669d31-e85f-4e5d-bfe2-3421a7fe2fe5 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: 31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:02:00.571097 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-eb669d31-e85f-4e5d-bfe2-3421a7fe2fe5 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:00.571777 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-eb669d31-e85f-4e5d-bfe2-3421a7fe2fe5 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:00.572316 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-eb669d31-e85f-4e5d-bfe2-3421a7fe2fe5 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:00.573144 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-eb669d31-e85f-4e5d-bfe2-3421a7fe2fe5 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:00.573700 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-eb669d31-e85f-4e5d-bfe2-3421a7fe2fe5 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:00.574246 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-eb669d31-e85f-4e5d-bfe2-3421a7fe2fe5 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:00.626211 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [req-9f239257-80a0-438a-97a4-d0b2b64a8d47 req-35e870fe-2094-42a9-9976-18f34dc93093 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed", "tag": "5db3f93c-3ea8-4e55-9a42-5db856dcb138"}]} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:02:00.648031 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-9f239257-80a0-438a-97a4-d0b2b64a8d47 req-35e870fe-2094-42a9-9976-18f34dc93093 service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:00.648838 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-9f239257-80a0-438a-97a4-d0b2b64a8d47 req-35e870fe-2094-42a9-9976-18f34dc93093 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:00.649562 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-9f239257-80a0-438a-97a4-d0b2b64a8d47 req-35e870fe-2094-42a9-9976-18f34dc93093 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:00.667345 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.compute.server_external_events [req-9f239257-80a0-438a-97a4-d0b2b64a8d47 req-35e870fe-2094-42a9-9976-18f34dc93093 service nova] Creating event network-changed:5db3f93c-3ea8-4e55-9a42-5db856dcb138 for instance 31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed on hv-cinder-83538 Aug 26 01:02:00.676051 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [req-9f239257-80a0-438a-97a4-d0b2b64a8d47 req-35e870fe-2094-42a9-9976-18f34dc93093 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053472 Aug 26 01:02:00.676826 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 442/878] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 01:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 01:02:00.730089 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-eb669d31-e85f-4e5d-bfe2-3421a7fe2fe5 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:02:00.740630 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-eb669d31-e85f-4e5d-bfe2-3421a7fe2fe5 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed" status: 200 len: 1279 microversion: 2.1 time: 0.179063 Aug 26 01:02:00.751394 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 437/879] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:02:00 2022] GET /compute/v2.1/servers/31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed => generated 1279 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 01:02:01.759670 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-113647ef-ffde-4bc3-b4d5-f0ee816e1a75 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:02:01.760376 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-113647ef-ffde-4bc3-b4d5-f0ee816e1a75 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: 31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:02:01.766927 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-113647ef-ffde-4bc3-b4d5-f0ee816e1a75 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:01.767623 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-113647ef-ffde-4bc3-b4d5-f0ee816e1a75 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:01.768065 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-113647ef-ffde-4bc3-b4d5-f0ee816e1a75 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:01.768791 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-113647ef-ffde-4bc3-b4d5-f0ee816e1a75 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:01.769252 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-113647ef-ffde-4bc3-b4d5-f0ee816e1a75 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:01.769679 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-113647ef-ffde-4bc3-b4d5-f0ee816e1a75 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:02.009712 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-113647ef-ffde-4bc3-b4d5-f0ee816e1a75 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:02:02.019556 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-113647ef-ffde-4bc3-b4d5-f0ee816e1a75 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed" status: 200 len: 1279 microversion: 2.1 time: 0.263984 Aug 26 01:02:02.020376 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 443/880] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:02:01 2022] GET /compute/v2.1/servers/31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed => generated 1279 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:02:03.052817 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-e55b7659-434e-4a06-868f-2c7a9f7fd8d2 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:02:03.053494 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-e55b7659-434e-4a06-868f-2c7a9f7fd8d2 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: 31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:02:03.062009 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e55b7659-434e-4a06-868f-2c7a9f7fd8d2 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:03.062143 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e55b7659-434e-4a06-868f-2c7a9f7fd8d2 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:03.062482 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e55b7659-434e-4a06-868f-2c7a9f7fd8d2 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:03.063181 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e55b7659-434e-4a06-868f-2c7a9f7fd8d2 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:03.063801 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e55b7659-434e-4a06-868f-2c7a9f7fd8d2 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:03.064230 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e55b7659-434e-4a06-868f-2c7a9f7fd8d2 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:03.261347 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-e55b7659-434e-4a06-868f-2c7a9f7fd8d2 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:02:03.274135 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-e55b7659-434e-4a06-868f-2c7a9f7fd8d2 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed" status: 200 len: 1279 microversion: 2.1 time: 0.226711 Aug 26 01:02:03.275079 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 438/881] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:02:03 2022] GET /compute/v2.1/servers/31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed => generated 1279 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:02:04.295037 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-dfd3847f-b971-4329-a721-bc95e1e509dd tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:02:04.296990 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-dfd3847f-b971-4329-a721-bc95e1e509dd tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: 31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:02:04.309121 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-dfd3847f-b971-4329-a721-bc95e1e509dd tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:04.309843 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-dfd3847f-b971-4329-a721-bc95e1e509dd tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:04.310281 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-dfd3847f-b971-4329-a721-bc95e1e509dd tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:04.310987 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-dfd3847f-b971-4329-a721-bc95e1e509dd tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:04.311629 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-dfd3847f-b971-4329-a721-bc95e1e509dd tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:04.312222 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-dfd3847f-b971-4329-a721-bc95e1e509dd tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:04.480848 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-dfd3847f-b971-4329-a721-bc95e1e509dd tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:02:04.490873 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-dfd3847f-b971-4329-a721-bc95e1e509dd tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed" status: 200 len: 1279 microversion: 2.1 time: 0.200662 Aug 26 01:02:04.503825 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 444/882] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:02:04 2022] GET /compute/v2.1/servers/31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed => generated 1279 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:02:05.512177 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-970316aa-2d38-4bfb-9617-ae5628f6761b tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:02:05.512902 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-970316aa-2d38-4bfb-9617-ae5628f6761b tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: 31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:02:05.516660 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell0:SELECT=2 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:02:05.525374 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell0:SELECT=6 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:02:05.525374 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-970316aa-2d38-4bfb-9617-ae5628f6761b tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:05.525374 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-970316aa-2d38-4bfb-9617-ae5628f6761b tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:05.525374 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-970316aa-2d38-4bfb-9617-ae5628f6761b tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:05.525833 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-970316aa-2d38-4bfb-9617-ae5628f6761b tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:05.525833 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-970316aa-2d38-4bfb-9617-ae5628f6761b tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:05.525833 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-970316aa-2d38-4bfb-9617-ae5628f6761b tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:05.729272 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-970316aa-2d38-4bfb-9617-ae5628f6761b tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:02:05.738296 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-970316aa-2d38-4bfb-9617-ae5628f6761b tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed" status: 200 len: 1279 microversion: 2.1 time: 0.230280 Aug 26 01:02:05.751999 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 439/883] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:02:05 2022] GET /compute/v2.1/servers/31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed => generated 1279 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:02:06.325649 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-7896c191-a45f-47ca-8234-cc827632e084 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Action: 'create', calling method: .version_select at 0x7f8a96664550>, body: {"keypair": {"name": "tempest-keypair-346910097", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKAhlaNCqHcBNin0lNBnzZhhooxQdP6pLr7dj2ZlLbPQ2PLJA0w8hXLfB3stsf3e2Ldj6+jrsJoxedhqn98enZKgAJgZAbu1+78mDB6lJWT87FUtMwxZD78WHYqT2SblYQ=="}} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:02:06.334862 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell0:SELECT=2 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:02:06.363078 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.quota [None req-7896c191-a45f-47ca-8234-cc827632e084 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Getting quotas for project 03b021c415a147e08dbfede2ddc8cc27. Resources: {'key_pairs'} {{(pid=127564) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 01:02:06.369713 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.quota [None req-7896c191-a45f-47ca-8234-cc827632e084 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Getting quotas for user 38047508b7d44f05af7116a15ba7e319 and project 03b021c415a147e08dbfede2ddc8cc27. Resources: {'key_pairs'} {{(pid=127564) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 01:02:06.472014 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-7896c191-a45f-47ca-8234-cc827632e084 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.150307 Aug 26 01:02:06.491133 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 445/884] 10.222.0.59 () {60 vars in 1159 bytes} [Fri Aug 26 01:02:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:02:06.759383 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-58f7ef45-41a8-41f2-ac25-1775af785fa2 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:02:06.760118 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-58f7ef45-41a8-41f2-ac25-1775af785fa2 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: 31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:02:06.767054 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-58f7ef45-41a8-41f2-ac25-1775af785fa2 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:06.775895 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-58f7ef45-41a8-41f2-ac25-1775af785fa2 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:06.775895 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-58f7ef45-41a8-41f2-ac25-1775af785fa2 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:06.775895 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-58f7ef45-41a8-41f2-ac25-1775af785fa2 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:06.775895 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-58f7ef45-41a8-41f2-ac25-1775af785fa2 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:06.776282 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-58f7ef45-41a8-41f2-ac25-1775af785fa2 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:07.002694 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-58f7ef45-41a8-41f2-ac25-1775af785fa2 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:02:07.029733 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-58f7ef45-41a8-41f2-ac25-1775af785fa2 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed" status: 200 len: 1279 microversion: 2.1 time: 0.274335 Aug 26 01:02:07.033623 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 440/885] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:02:06 2022] GET /compute/v2.1/servers/31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed => generated 1279 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:02:07.704987 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-d2ed9358-7d93-4347-a910-9dd0a39791ef tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Action: 'create', calling method: .version_select at 0x7f8a9666f0d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1155807456", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKGT6ztkKIR9LFDEgxBSTdi0jOuskUH57jpVkjZFP0x/M9e3x5tpRBKHlkbmLO0LN9j/luffC7Uet6f4WHIBxfEK5jN2Ik3DR3x2kpPyqQJ6BGJJs32CldYX/wEmL4IadA=="}} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:02:07.722383 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.quota [None req-d2ed9358-7d93-4347-a910-9dd0a39791ef tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Getting quotas for project a223be1c2f6a4cd281b20b0bc7281554. Resources: {'key_pairs'} {{(pid=127564) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 01:02:07.726077 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.quota [None req-d2ed9358-7d93-4347-a910-9dd0a39791ef tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Getting quotas for user 83076e7b11fb446ca50f23fe8e6e7ab6 and project a223be1c2f6a4cd281b20b0bc7281554. Resources: {'key_pairs'} {{(pid=127564) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 01:02:07.831425 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-d2ed9358-7d93-4347-a910-9dd0a39791ef tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.349876 Aug 26 01:02:07.832512 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 446/886] 10.222.0.59 () {60 vars in 1159 bytes} [Fri Aug 26 01:02:07 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 01:02:08.053563 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-02d196a2-7d8d-4323-9135-9adaa988da8b tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:02:08.054177 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-02d196a2-7d8d-4323-9135-9adaa988da8b tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: 31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:02:08.062419 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-02d196a2-7d8d-4323-9135-9adaa988da8b tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:08.062911 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-02d196a2-7d8d-4323-9135-9adaa988da8b tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:08.063348 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-02d196a2-7d8d-4323-9135-9adaa988da8b tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:08.064052 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-02d196a2-7d8d-4323-9135-9adaa988da8b tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:08.064524 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-02d196a2-7d8d-4323-9135-9adaa988da8b tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:08.065146 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-02d196a2-7d8d-4323-9135-9adaa988da8b tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:08.462404 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-02d196a2-7d8d-4323-9135-9adaa988da8b tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:02:08.470722 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-02d196a2-7d8d-4323-9135-9adaa988da8b tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed" status: 200 len: 1267 microversion: 2.1 time: 0.420987 Aug 26 01:02:08.471372 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 441/887] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:02:08 2022] GET /compute/v2.1/servers/31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed => generated 1267 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:02:09.492799 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-e7ddcf75-f8b5-4957-b192-6454f1af9ae7 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:02:09.493492 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-e7ddcf75-f8b5-4957-b192-6454f1af9ae7 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: 31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:02:09.500299 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e7ddcf75-f8b5-4957-b192-6454f1af9ae7 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:09.500823 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e7ddcf75-f8b5-4957-b192-6454f1af9ae7 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:09.501251 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e7ddcf75-f8b5-4957-b192-6454f1af9ae7 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:09.501953 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e7ddcf75-f8b5-4957-b192-6454f1af9ae7 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:09.502585 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e7ddcf75-f8b5-4957-b192-6454f1af9ae7 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:09.503009 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e7ddcf75-f8b5-4957-b192-6454f1af9ae7 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:09.654528 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-e7ddcf75-f8b5-4957-b192-6454f1af9ae7 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:02:09.662782 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-e7ddcf75-f8b5-4957-b192-6454f1af9ae7 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed" status: 200 len: 1267 microversion: 2.1 time: 0.174625 Aug 26 01:02:09.665743 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 447/888] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:02:09 2022] GET /compute/v2.1/servers/31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 01:02:09.718957 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-3b9713c7-9b99-4b29-8187-3c03328e2ead tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-760541118", "imageRef": "ef60327f-6e0c-4f85-8db9-6f6e8968fe9c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "de5adc9b-87c3-4a41-9cca-c473a399648a"}], "security_groups": [{"name": "tempest-securitygroup--835004462"}], "key_name": "tempest-keypair-346910097", "user_data": "}} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:02:09.853738 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.network.neutron [None req-3b9713c7-9b99-4b29-8187-3c03328e2ead tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] validate_networks() for [('de5adc9b-87c3-4a41-9cca-c473a399648a', None, None, None, None, None)] {{(pid=127565) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 01:02:10.330524 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.virt.hardware [None req-3b9713c7-9b99-4b29-8187-3c03328e2ead tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Flavor limits 0:0:0 {{(pid=127565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 01:02:10.331218 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.virt.hardware [None req-3b9713c7-9b99-4b29-8187-3c03328e2ead tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Image limits 0:0:0 {{(pid=127565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 01:02:10.331833 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.virt.hardware [None req-3b9713c7-9b99-4b29-8187-3c03328e2ead tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Flavor pref 0:0:0 {{(pid=127565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 01:02:10.332331 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.virt.hardware [None req-3b9713c7-9b99-4b29-8187-3c03328e2ead tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Image pref 0:0:0 {{(pid=127565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 01:02:10.332863 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.virt.hardware [None req-3b9713c7-9b99-4b29-8187-3c03328e2ead tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 01:02:10.342275 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3b9713c7-9b99-4b29-8187-3c03328e2ead tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:10.342275 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3b9713c7-9b99-4b29-8187-3c03328e2ead tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:10.342765 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3b9713c7-9b99-4b29-8187-3c03328e2ead tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:10.343489 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3b9713c7-9b99-4b29-8187-3c03328e2ead tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:10.343966 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3b9713c7-9b99-4b29-8187-3c03328e2ead tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:10.344386 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3b9713c7-9b99-4b29-8187-3c03328e2ead tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:10.361152 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.quota [None req-3b9713c7-9b99-4b29-8187-3c03328e2ead tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Getting quotas for project 03b021c415a147e08dbfede2ddc8cc27. Resources: {'instances', 'ram', 'cores'} {{(pid=127565) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 01:02:10.364831 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.quota [None req-3b9713c7-9b99-4b29-8187-3c03328e2ead tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Getting quotas for user 38047508b7d44f05af7116a15ba7e319 and project 03b021c415a147e08dbfede2ddc8cc27. Resources: {'instances', 'ram', 'cores'} {{(pid=127565) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 01:02:10.376525 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-3b9713c7-9b99-4b29-8187-3c03328e2ead tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Going to run 1 instances... {{(pid=127565) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 01:02:10.378778 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-3b9713c7-9b99-4b29-8187-3c03328e2ead tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: 3955819b-d03a-4684-aba7-5d485c66a29e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ef60327f-6e0c-4f85-8db9-6f6e8968fe9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127565) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 01:02:10.591538 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-3b9713c7-9b99-4b29-8187-3c03328e2ead tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.876919 Aug 26 01:02:10.594520 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 442/889] 10.222.0.59 () {60 vars in 1147 bytes} [Fri Aug 26 01:02:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 880 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 01:02:10.608448 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-fb4eab81-73d1-495f-ab3d-61de768d55a4 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:02:10.609793 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-fb4eab81-73d1-495f-ab3d-61de768d55a4 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: 3955819b-d03a-4684-aba7-5d485c66a29e] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:02:10.686947 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-d44edcbe-36dc-42ad-a9ea-4644e5c57b31 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:02:10.687773 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-d44edcbe-36dc-42ad-a9ea-4644e5c57b31 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: 31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:02:10.700439 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-fb4eab81-73d1-495f-ab3d-61de768d55a4 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38047508b7d44f05af7116a15ba7e319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b021c415a147e08dbfede2ddc8cc27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:02:10.706788 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-fb4eab81-73d1-495f-ab3d-61de768d55a4 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/3955819b-d03a-4684-aba7-5d485c66a29e" status: 200 len: 1240 microversion: 2.1 time: 0.102954 Aug 26 01:02:10.710523 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d44edcbe-36dc-42ad-a9ea-4644e5c57b31 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:10.711292 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d44edcbe-36dc-42ad-a9ea-4644e5c57b31 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:10.712074 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 448/890] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:02:10 2022] GET /compute/v2.1/servers/3955819b-d03a-4684-aba7-5d485c66a29e => generated 1240 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:02:10.712622 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d44edcbe-36dc-42ad-a9ea-4644e5c57b31 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:10.713473 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d44edcbe-36dc-42ad-a9ea-4644e5c57b31 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:10.714041 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d44edcbe-36dc-42ad-a9ea-4644e5c57b31 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:10.714671 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d44edcbe-36dc-42ad-a9ea-4644e5c57b31 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:10.884120 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-d44edcbe-36dc-42ad-a9ea-4644e5c57b31 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:02:10.894156 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-d44edcbe-36dc-42ad-a9ea-4644e5c57b31 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed" status: 200 len: 1267 microversion: 2.1 time: 0.211615 Aug 26 01:02:10.894767 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 443/891] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:02:10 2022] GET /compute/v2.1/servers/31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed => generated 1267 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:02:11.732246 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-84c5ba22-dff0-4fa4-8fd1-40d48ab7c96b tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:02:11.733271 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-84c5ba22-dff0-4fa4-8fd1-40d48ab7c96b tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: 3955819b-d03a-4684-aba7-5d485c66a29e] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:02:11.740747 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-84c5ba22-dff0-4fa4-8fd1-40d48ab7c96b tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:11.741224 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-84c5ba22-dff0-4fa4-8fd1-40d48ab7c96b tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:11.741653 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-84c5ba22-dff0-4fa4-8fd1-40d48ab7c96b tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:11.742327 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-84c5ba22-dff0-4fa4-8fd1-40d48ab7c96b tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:11.742769 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-84c5ba22-dff0-4fa4-8fd1-40d48ab7c96b tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:11.743183 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-84c5ba22-dff0-4fa4-8fd1-40d48ab7c96b tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:11.810069 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-84c5ba22-dff0-4fa4-8fd1-40d48ab7c96b tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38047508b7d44f05af7116a15ba7e319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b021c415a147e08dbfede2ddc8cc27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:02:11.818430 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-84c5ba22-dff0-4fa4-8fd1-40d48ab7c96b tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/3955819b-d03a-4684-aba7-5d485c66a29e" status: 200 len: 1244 microversion: 2.1 time: 0.090493 Aug 26 01:02:11.818989 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 449/892] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:02:11 2022] GET /compute/v2.1/servers/3955819b-d03a-4684-aba7-5d485c66a29e => generated 1244 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:02:11.915319 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-499ab29a-970f-486b-9769-efe6a9cee120 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:02:11.916567 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-499ab29a-970f-486b-9769-efe6a9cee120 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: 31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:02:11.924373 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-499ab29a-970f-486b-9769-efe6a9cee120 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:11.925072 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-499ab29a-970f-486b-9769-efe6a9cee120 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:11.926479 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-499ab29a-970f-486b-9769-efe6a9cee120 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:11.927507 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-499ab29a-970f-486b-9769-efe6a9cee120 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:11.928123 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-499ab29a-970f-486b-9769-efe6a9cee120 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:11.928753 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-499ab29a-970f-486b-9769-efe6a9cee120 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:12.112874 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-499ab29a-970f-486b-9769-efe6a9cee120 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:02:12.112874 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-499ab29a-970f-486b-9769-efe6a9cee120 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed" status: 200 len: 1267 microversion: 2.1 time: 0.200590 Aug 26 01:02:12.124980 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 444/893] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:02:11 2022] GET /compute/v2.1/servers/31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed => generated 1267 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:02:12.839600 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-1cbe0143-d6a9-4b58-a55d-481fd7b93c07 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:02:12.840374 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-1cbe0143-d6a9-4b58-a55d-481fd7b93c07 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: 3955819b-d03a-4684-aba7-5d485c66a29e] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:02:12.847596 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1cbe0143-d6a9-4b58-a55d-481fd7b93c07 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:12.848222 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1cbe0143-d6a9-4b58-a55d-481fd7b93c07 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:12.848713 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1cbe0143-d6a9-4b58-a55d-481fd7b93c07 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:12.849448 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1cbe0143-d6a9-4b58-a55d-481fd7b93c07 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:12.849957 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1cbe0143-d6a9-4b58-a55d-481fd7b93c07 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:12.850410 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1cbe0143-d6a9-4b58-a55d-481fd7b93c07 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:12.915938 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-1cbe0143-d6a9-4b58-a55d-481fd7b93c07 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38047508b7d44f05af7116a15ba7e319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b021c415a147e08dbfede2ddc8cc27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:02:12.923664 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-1cbe0143-d6a9-4b58-a55d-481fd7b93c07 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/3955819b-d03a-4684-aba7-5d485c66a29e" status: 200 len: 1292 microversion: 2.1 time: 0.088169 Aug 26 01:02:12.935635 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 450/894] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:02:12 2022] GET /compute/v2.1/servers/3955819b-d03a-4684-aba7-5d485c66a29e => generated 1292 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:02:13.133881 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-b47e0fb9-a3ad-472e-8f12-56a642683957 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:02:13.134501 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-b47e0fb9-a3ad-472e-8f12-56a642683957 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: 31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:02:13.141678 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b47e0fb9-a3ad-472e-8f12-56a642683957 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:13.142138 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b47e0fb9-a3ad-472e-8f12-56a642683957 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:13.142588 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b47e0fb9-a3ad-472e-8f12-56a642683957 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:13.143291 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b47e0fb9-a3ad-472e-8f12-56a642683957 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:13.143721 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b47e0fb9-a3ad-472e-8f12-56a642683957 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:13.144136 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b47e0fb9-a3ad-472e-8f12-56a642683957 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:13.297041 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-b47e0fb9-a3ad-472e-8f12-56a642683957 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:02:13.305302 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-b47e0fb9-a3ad-472e-8f12-56a642683957 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed" status: 200 len: 1267 microversion: 2.1 time: 0.175431 Aug 26 01:02:13.305873 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 445/895] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:02:13 2022] GET /compute/v2.1/servers/31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:02:13.947517 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-58cc5322-d26a-4f8e-8ea6-4e319807eb4f tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:02:13.949757 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-58cc5322-d26a-4f8e-8ea6-4e319807eb4f tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: 3955819b-d03a-4684-aba7-5d485c66a29e] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:02:13.957921 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-58cc5322-d26a-4f8e-8ea6-4e319807eb4f tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:13.959080 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-58cc5322-d26a-4f8e-8ea6-4e319807eb4f tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:13.959798 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-58cc5322-d26a-4f8e-8ea6-4e319807eb4f tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:13.960682 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-58cc5322-d26a-4f8e-8ea6-4e319807eb4f tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:13.961193 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-58cc5322-d26a-4f8e-8ea6-4e319807eb4f tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:13.961843 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-58cc5322-d26a-4f8e-8ea6-4e319807eb4f tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:14.044910 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-58cc5322-d26a-4f8e-8ea6-4e319807eb4f tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38047508b7d44f05af7116a15ba7e319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b021c415a147e08dbfede2ddc8cc27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:02:14.059482 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-58cc5322-d26a-4f8e-8ea6-4e319807eb4f tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/3955819b-d03a-4684-aba7-5d485c66a29e" status: 200 len: 1300 microversion: 2.1 time: 0.118302 Aug 26 01:02:14.060057 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 451/896] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:02:13 2022] GET /compute/v2.1/servers/3955819b-d03a-4684-aba7-5d485c66a29e => generated 1300 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:02:14.327748 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-c0de364b-1edd-4eb3-9145-22afd40b64ee tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:02:14.328448 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-c0de364b-1edd-4eb3-9145-22afd40b64ee tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: 31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:02:14.340146 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c0de364b-1edd-4eb3-9145-22afd40b64ee tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:14.340863 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c0de364b-1edd-4eb3-9145-22afd40b64ee tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:14.341256 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c0de364b-1edd-4eb3-9145-22afd40b64ee tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:14.342676 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c0de364b-1edd-4eb3-9145-22afd40b64ee tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:14.342676 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c0de364b-1edd-4eb3-9145-22afd40b64ee tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:14.343009 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c0de364b-1edd-4eb3-9145-22afd40b64ee tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:14.481598 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-c0de364b-1edd-4eb3-9145-22afd40b64ee tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:02:14.490104 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-c0de364b-1edd-4eb3-9145-22afd40b64ee tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed" status: 200 len: 1267 microversion: 2.1 time: 0.167247 Aug 26 01:02:14.490663 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 446/897] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:02:14 2022] GET /compute/v2.1/servers/31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 01:02:15.083534 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-ee4fb0b9-317a-4676-98b0-c5a8e236fbc1 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:02:15.085392 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-ee4fb0b9-317a-4676-98b0-c5a8e236fbc1 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: 3955819b-d03a-4684-aba7-5d485c66a29e] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:02:15.093289 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ee4fb0b9-317a-4676-98b0-c5a8e236fbc1 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:15.093784 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ee4fb0b9-317a-4676-98b0-c5a8e236fbc1 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:15.094247 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ee4fb0b9-317a-4676-98b0-c5a8e236fbc1 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:15.094956 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ee4fb0b9-317a-4676-98b0-c5a8e236fbc1 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:15.095781 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ee4fb0b9-317a-4676-98b0-c5a8e236fbc1 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:15.096208 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ee4fb0b9-317a-4676-98b0-c5a8e236fbc1 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:15.335654 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-ee4fb0b9-317a-4676-98b0-c5a8e236fbc1 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38047508b7d44f05af7116a15ba7e319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b021c415a147e08dbfede2ddc8cc27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:02:15.352825 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-ee4fb0b9-317a-4676-98b0-c5a8e236fbc1 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/3955819b-d03a-4684-aba7-5d485c66a29e" status: 200 len: 1365 microversion: 2.1 time: 0.272968 Aug 26 01:02:15.353666 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 452/898] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:02:15 2022] GET /compute/v2.1/servers/3955819b-d03a-4684-aba7-5d485c66a29e => generated 1365 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:02:15.511163 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-f9f879d3-27ae-4385-9354-f8b6041a02b6 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:02:15.511899 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-f9f879d3-27ae-4385-9354-f8b6041a02b6 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: 31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:02:15.519097 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f9f879d3-27ae-4385-9354-f8b6041a02b6 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:15.519610 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f9f879d3-27ae-4385-9354-f8b6041a02b6 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:15.520119 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f9f879d3-27ae-4385-9354-f8b6041a02b6 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:15.520915 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f9f879d3-27ae-4385-9354-f8b6041a02b6 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:15.521438 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f9f879d3-27ae-4385-9354-f8b6041a02b6 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:15.521925 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f9f879d3-27ae-4385-9354-f8b6041a02b6 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:15.679577 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-f9f879d3-27ae-4385-9354-f8b6041a02b6 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:02:15.690430 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-f9f879d3-27ae-4385-9354-f8b6041a02b6 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed" status: 200 len: 1267 microversion: 2.1 time: 0.183231 Aug 26 01:02:15.691000 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 447/899] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:02:15 2022] GET /compute/v2.1/servers/31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed => generated 1267 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:02:15.884164 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [req-de1f05d7-eafd-4b89-b5c4-1c64df9a91ef req-316a8e22-e08c-46d1-8d48-98537d2807ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3955819b-d03a-4684-aba7-5d485c66a29e", "tag": "66599df3-70a8-4a2f-b18a-a34433739290"}]} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:02:15.895302 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-de1f05d7-eafd-4b89-b5c4-1c64df9a91ef req-316a8e22-e08c-46d1-8d48-98537d2807ab service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:15.896050 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-de1f05d7-eafd-4b89-b5c4-1c64df9a91ef req-316a8e22-e08c-46d1-8d48-98537d2807ab service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:15.896508 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-de1f05d7-eafd-4b89-b5c4-1c64df9a91ef req-316a8e22-e08c-46d1-8d48-98537d2807ab service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:15.908357 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.compute.server_external_events [req-de1f05d7-eafd-4b89-b5c4-1c64df9a91ef req-316a8e22-e08c-46d1-8d48-98537d2807ab service nova] Creating event network-changed:66599df3-70a8-4a2f-b18a-a34433739290 for instance 3955819b-d03a-4684-aba7-5d485c66a29e on hv-cinder-83538 Aug 26 01:02:15.914400 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [req-de1f05d7-eafd-4b89-b5c4-1c64df9a91ef req-316a8e22-e08c-46d1-8d48-98537d2807ab service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033754 Aug 26 01:02:15.915153 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 453/900] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 01:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:02:16.373962 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-4af63b03-658e-4541-ac51-adb597020116 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:02:16.374478 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-4af63b03-658e-4541-ac51-adb597020116 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: 3955819b-d03a-4684-aba7-5d485c66a29e] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:02:16.380437 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4af63b03-658e-4541-ac51-adb597020116 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:16.380953 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4af63b03-658e-4541-ac51-adb597020116 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:16.381387 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4af63b03-658e-4541-ac51-adb597020116 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:16.382068 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4af63b03-658e-4541-ac51-adb597020116 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:16.382520 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4af63b03-658e-4541-ac51-adb597020116 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:16.382934 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4af63b03-658e-4541-ac51-adb597020116 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:16.536601 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-4af63b03-658e-4541-ac51-adb597020116 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38047508b7d44f05af7116a15ba7e319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b021c415a147e08dbfede2ddc8cc27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:02:16.545198 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-4af63b03-658e-4541-ac51-adb597020116 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/3955819b-d03a-4684-aba7-5d485c66a29e" status: 200 len: 1365 microversion: 2.1 time: 0.175062 Aug 26 01:02:16.547052 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 448/901] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:02:16 2022] GET /compute/v2.1/servers/3955819b-d03a-4684-aba7-5d485c66a29e => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:02:16.711992 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-81abae2d-2f5c-4585-88e6-fde71c2a6412 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:02:16.712849 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-81abae2d-2f5c-4585-88e6-fde71c2a6412 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: 31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:02:16.719740 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-81abae2d-2f5c-4585-88e6-fde71c2a6412 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:16.722044 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-81abae2d-2f5c-4585-88e6-fde71c2a6412 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:16.722044 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-81abae2d-2f5c-4585-88e6-fde71c2a6412 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:16.722044 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-81abae2d-2f5c-4585-88e6-fde71c2a6412 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:16.722044 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-81abae2d-2f5c-4585-88e6-fde71c2a6412 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:16.722668 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-81abae2d-2f5c-4585-88e6-fde71c2a6412 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:16.862809 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-81abae2d-2f5c-4585-88e6-fde71c2a6412 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:02:16.870608 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-81abae2d-2f5c-4585-88e6-fde71c2a6412 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed" status: 200 len: 1267 microversion: 2.1 time: 0.163339 Aug 26 01:02:16.871168 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 454/902] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:02:16 2022] GET /compute/v2.1/servers/31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:02:17.200339 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [req-749b4e57-4407-4b8c-8d8b-fd75be3ce1db req-b238dbcb-957c-4948-acf0-ccc9406269e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed", "name": "network-vif-plugged", "status": "completed", "tag": "5db3f93c-3ea8-4e55-9a42-5db856dcb138"}]} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:02:17.210301 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-749b4e57-4407-4b8c-8d8b-fd75be3ce1db req-b238dbcb-957c-4948-acf0-ccc9406269e0 service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:17.210784 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-749b4e57-4407-4b8c-8d8b-fd75be3ce1db req-b238dbcb-957c-4948-acf0-ccc9406269e0 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:17.211214 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-749b4e57-4407-4b8c-8d8b-fd75be3ce1db req-b238dbcb-957c-4948-acf0-ccc9406269e0 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:17.223205 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.compute.server_external_events [req-749b4e57-4407-4b8c-8d8b-fd75be3ce1db req-b238dbcb-957c-4948-acf0-ccc9406269e0 service nova] Creating event network-vif-plugged:5db3f93c-3ea8-4e55-9a42-5db856dcb138 for instance 31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed on hv-cinder-83538 Aug 26 01:02:17.228202 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [req-749b4e57-4407-4b8c-8d8b-fd75be3ce1db req-b238dbcb-957c-4948-acf0-ccc9406269e0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031772 Aug 26 01:02:17.233369 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 449/903] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 01:02:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:02:17.567649 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-73bf0018-adef-4abc-b675-392993fd4d73 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:02:17.568600 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-73bf0018-adef-4abc-b675-392993fd4d73 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: 3955819b-d03a-4684-aba7-5d485c66a29e] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:02:17.574960 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-73bf0018-adef-4abc-b675-392993fd4d73 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:17.575453 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-73bf0018-adef-4abc-b675-392993fd4d73 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:17.575888 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-73bf0018-adef-4abc-b675-392993fd4d73 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:17.576690 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-73bf0018-adef-4abc-b675-392993fd4d73 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:17.577146 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-73bf0018-adef-4abc-b675-392993fd4d73 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:17.577572 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-73bf0018-adef-4abc-b675-392993fd4d73 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:17.709790 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-73bf0018-adef-4abc-b675-392993fd4d73 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38047508b7d44f05af7116a15ba7e319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b021c415a147e08dbfede2ddc8cc27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:02:17.718666 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-73bf0018-adef-4abc-b675-392993fd4d73 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/3955819b-d03a-4684-aba7-5d485c66a29e" status: 200 len: 1365 microversion: 2.1 time: 0.154734 Aug 26 01:02:17.719294 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 455/904] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:02:17 2022] GET /compute/v2.1/servers/3955819b-d03a-4684-aba7-5d485c66a29e => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:02:17.892490 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-350e03e4-0c3a-4cd4-abc0-842755f99086 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:02:17.893351 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-350e03e4-0c3a-4cd4-abc0-842755f99086 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: 31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:02:17.899915 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-350e03e4-0c3a-4cd4-abc0-842755f99086 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:17.900401 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-350e03e4-0c3a-4cd4-abc0-842755f99086 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:17.900870 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-350e03e4-0c3a-4cd4-abc0-842755f99086 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:17.901557 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-350e03e4-0c3a-4cd4-abc0-842755f99086 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:17.902012 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-350e03e4-0c3a-4cd4-abc0-842755f99086 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:17.902438 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-350e03e4-0c3a-4cd4-abc0-842755f99086 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:18.053835 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-350e03e4-0c3a-4cd4-abc0-842755f99086 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:02:18.066151 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-350e03e4-0c3a-4cd4-abc0-842755f99086 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed" status: 200 len: 1267 microversion: 2.1 time: 0.178261 Aug 26 01:02:18.066992 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 450/905] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:02:17 2022] GET /compute/v2.1/servers/31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:02:18.739601 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-57df7dcf-3205-4422-b116-8109fb1f093a tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:02:18.740191 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-57df7dcf-3205-4422-b116-8109fb1f093a tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: 3955819b-d03a-4684-aba7-5d485c66a29e] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:02:18.747086 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-57df7dcf-3205-4422-b116-8109fb1f093a tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:18.747582 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-57df7dcf-3205-4422-b116-8109fb1f093a tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:18.748022 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-57df7dcf-3205-4422-b116-8109fb1f093a tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:18.748775 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-57df7dcf-3205-4422-b116-8109fb1f093a tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:18.749228 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-57df7dcf-3205-4422-b116-8109fb1f093a tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:18.749648 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-57df7dcf-3205-4422-b116-8109fb1f093a tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:18.882502 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-57df7dcf-3205-4422-b116-8109fb1f093a tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38047508b7d44f05af7116a15ba7e319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b021c415a147e08dbfede2ddc8cc27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:02:18.890922 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-57df7dcf-3205-4422-b116-8109fb1f093a tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/3955819b-d03a-4684-aba7-5d485c66a29e" status: 200 len: 1365 microversion: 2.1 time: 0.155243 Aug 26 01:02:18.891480 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 456/906] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:02:18 2022] GET /compute/v2.1/servers/3955819b-d03a-4684-aba7-5d485c66a29e => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:02:19.087407 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-d50482db-548d-4bdc-ac68-3f85980dc8ff tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:02:19.087986 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-d50482db-548d-4bdc-ac68-3f85980dc8ff tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: 31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:02:19.094437 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d50482db-548d-4bdc-ac68-3f85980dc8ff tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:19.095020 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d50482db-548d-4bdc-ac68-3f85980dc8ff tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:19.095529 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d50482db-548d-4bdc-ac68-3f85980dc8ff tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:19.096163 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d50482db-548d-4bdc-ac68-3f85980dc8ff tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:19.096673 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d50482db-548d-4bdc-ac68-3f85980dc8ff tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:19.097067 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d50482db-548d-4bdc-ac68-3f85980dc8ff tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:19.115753 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell1:SELECT=100 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:02:19.231692 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-d50482db-548d-4bdc-ac68-3f85980dc8ff tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:02:19.239875 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-d50482db-548d-4bdc-ac68-3f85980dc8ff tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed" status: 200 len: 1267 microversion: 2.1 time: 0.156625 Aug 26 01:02:19.240429 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 451/907] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:02:19 2022] GET /compute/v2.1/servers/31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:02:19.911208 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-5d5cfa3b-1041-40c0-a762-5fbb538b84ea tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:02:19.911859 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-5d5cfa3b-1041-40c0-a762-5fbb538b84ea tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: 3955819b-d03a-4684-aba7-5d485c66a29e] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:02:19.918683 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5d5cfa3b-1041-40c0-a762-5fbb538b84ea tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:19.919169 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5d5cfa3b-1041-40c0-a762-5fbb538b84ea tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:19.919605 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5d5cfa3b-1041-40c0-a762-5fbb538b84ea tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:19.920840 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5d5cfa3b-1041-40c0-a762-5fbb538b84ea tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:19.921296 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5d5cfa3b-1041-40c0-a762-5fbb538b84ea tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:19.921721 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5d5cfa3b-1041-40c0-a762-5fbb538b84ea tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:20.053894 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-5d5cfa3b-1041-40c0-a762-5fbb538b84ea tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38047508b7d44f05af7116a15ba7e319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b021c415a147e08dbfede2ddc8cc27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:02:20.061917 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-5d5cfa3b-1041-40c0-a762-5fbb538b84ea tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/3955819b-d03a-4684-aba7-5d485c66a29e" status: 200 len: 1365 microversion: 2.1 time: 0.154562 Aug 26 01:02:20.062485 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 457/908] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:02:19 2022] GET /compute/v2.1/servers/3955819b-d03a-4684-aba7-5d485c66a29e => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:02:20.260591 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-9203cf80-6eef-4986-af74-466429a093d7 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:02:20.261203 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-9203cf80-6eef-4986-af74-466429a093d7 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: 31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:02:20.268536 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9203cf80-6eef-4986-af74-466429a093d7 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:20.269026 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9203cf80-6eef-4986-af74-466429a093d7 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:20.269464 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9203cf80-6eef-4986-af74-466429a093d7 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:20.270162 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9203cf80-6eef-4986-af74-466429a093d7 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:20.270614 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9203cf80-6eef-4986-af74-466429a093d7 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:20.271039 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9203cf80-6eef-4986-af74-466429a093d7 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:20.353785 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell0:SELECT=2 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:02:20.371903 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell0:SELECT=6 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:02:20.408009 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-9203cf80-6eef-4986-af74-466429a093d7 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:02:20.416399 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-9203cf80-6eef-4986-af74-466429a093d7 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed" status: 200 len: 1455 microversion: 2.1 time: 0.160123 Aug 26 01:02:20.418978 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 452/909] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:02:20 2022] GET /compute/v2.1/servers/31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed => generated 1455 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:02:20.436362 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-151ac072-de04-4b56-8573-50f62b51041f tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:02:20.437007 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-151ac072-de04-4b56-8573-50f62b51041f tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: 31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:02:20.443211 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-151ac072-de04-4b56-8573-50f62b51041f tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:20.443711 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-151ac072-de04-4b56-8573-50f62b51041f tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:20.444158 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-151ac072-de04-4b56-8573-50f62b51041f tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:20.444899 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-151ac072-de04-4b56-8573-50f62b51041f tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:20.445354 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-151ac072-de04-4b56-8573-50f62b51041f tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:20.445832 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-151ac072-de04-4b56-8573-50f62b51041f tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:20.583727 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-151ac072-de04-4b56-8573-50f62b51041f tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:02:20.587481 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:02:20.592167 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-151ac072-de04-4b56-8573-50f62b51041f tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed" status: 200 len: 1455 microversion: 2.1 time: 0.159594 Aug 26 01:02:20.592787 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 458/910] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:02:20 2022] GET /compute/v2.1/servers/31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed => generated 1455 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:02:21.083942 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-a6cd6d13-2103-4e74-acd1-180f9e1f75a7 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:02:21.084872 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-a6cd6d13-2103-4e74-acd1-180f9e1f75a7 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: 3955819b-d03a-4684-aba7-5d485c66a29e] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:02:21.092560 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a6cd6d13-2103-4e74-acd1-180f9e1f75a7 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:21.093048 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a6cd6d13-2103-4e74-acd1-180f9e1f75a7 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:21.093477 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a6cd6d13-2103-4e74-acd1-180f9e1f75a7 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:21.094173 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a6cd6d13-2103-4e74-acd1-180f9e1f75a7 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:21.094617 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a6cd6d13-2103-4e74-acd1-180f9e1f75a7 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:21.095036 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a6cd6d13-2103-4e74-acd1-180f9e1f75a7 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:21.240885 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [req-bf7b9f03-9c49-4247-a396-fe47a93426d2 req-063acd4c-fc74-449f-bece-7a1cffe50a82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3955819b-d03a-4684-aba7-5d485c66a29e", "name": "network-vif-plugged", "status": "completed", "tag": "66599df3-70a8-4a2f-b18a-a34433739290"}]} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:02:21.248192 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell0:SELECT=10 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:02:21.255847 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-bf7b9f03-9c49-4247-a396-fe47a93426d2 req-063acd4c-fc74-449f-bece-7a1cffe50a82 service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:21.256767 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-bf7b9f03-9c49-4247-a396-fe47a93426d2 req-063acd4c-fc74-449f-bece-7a1cffe50a82 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:21.257469 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-bf7b9f03-9c49-4247-a396-fe47a93426d2 req-063acd4c-fc74-449f-bece-7a1cffe50a82 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:21.265517 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-a6cd6d13-2103-4e74-acd1-180f9e1f75a7 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38047508b7d44f05af7116a15ba7e319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b021c415a147e08dbfede2ddc8cc27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:02:21.271158 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.compute.server_external_events [req-bf7b9f03-9c49-4247-a396-fe47a93426d2 req-063acd4c-fc74-449f-bece-7a1cffe50a82 service nova] Creating event network-vif-plugged:66599df3-70a8-4a2f-b18a-a34433739290 for instance 3955819b-d03a-4684-aba7-5d485c66a29e on hv-cinder-83538 Aug 26 01:02:21.275271 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-a6cd6d13-2103-4e74-acd1-180f9e1f75a7 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/3955819b-d03a-4684-aba7-5d485c66a29e" status: 200 len: 1365 microversion: 2.1 time: 0.196867 Aug 26 01:02:21.276057 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 453/911] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:02:21 2022] GET /compute/v2.1/servers/3955819b-d03a-4684-aba7-5d485c66a29e => generated 1365 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:02:21.283287 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [req-bf7b9f03-9c49-4247-a396-fe47a93426d2 req-063acd4c-fc74-449f-bece-7a1cffe50a82 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041072 Aug 26 01:02:21.284029 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 459/912] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 01:02:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 01:02:22.298830 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-db627cd9-a80f-47a8-a270-8eb18c1d136a tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:02:22.299359 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-db627cd9-a80f-47a8-a270-8eb18c1d136a tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: 3955819b-d03a-4684-aba7-5d485c66a29e] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:02:22.306002 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-db627cd9-a80f-47a8-a270-8eb18c1d136a tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:22.306481 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-db627cd9-a80f-47a8-a270-8eb18c1d136a tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:22.306973 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-db627cd9-a80f-47a8-a270-8eb18c1d136a tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:22.307658 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-db627cd9-a80f-47a8-a270-8eb18c1d136a tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:22.308108 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-db627cd9-a80f-47a8-a270-8eb18c1d136a tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:22.308564 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-db627cd9-a80f-47a8-a270-8eb18c1d136a tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:22.440702 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-db627cd9-a80f-47a8-a270-8eb18c1d136a tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38047508b7d44f05af7116a15ba7e319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b021c415a147e08dbfede2ddc8cc27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:02:22.448549 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-db627cd9-a80f-47a8-a270-8eb18c1d136a tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/3955819b-d03a-4684-aba7-5d485c66a29e" status: 200 len: 1365 microversion: 2.1 time: 0.153661 Aug 26 01:02:22.453471 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 454/913] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:02:22 2022] GET /compute/v2.1/servers/3955819b-d03a-4684-aba7-5d485c66a29e => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:02:23.211169 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [req-b0414a03-2de3-45a9-890d-5e697cc5469a req-cd8fe33a-2fe6-43b3-b70d-915c55c666a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed", "tag": "5db3f93c-3ea8-4e55-9a42-5db856dcb138"}]} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:02:23.222023 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-b0414a03-2de3-45a9-890d-5e697cc5469a req-cd8fe33a-2fe6-43b3-b70d-915c55c666a7 service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:23.222500 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-b0414a03-2de3-45a9-890d-5e697cc5469a req-cd8fe33a-2fe6-43b3-b70d-915c55c666a7 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:23.222929 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-b0414a03-2de3-45a9-890d-5e697cc5469a req-cd8fe33a-2fe6-43b3-b70d-915c55c666a7 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:23.233833 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.compute.server_external_events [req-b0414a03-2de3-45a9-890d-5e697cc5469a req-cd8fe33a-2fe6-43b3-b70d-915c55c666a7 service nova] Creating event network-changed:5db3f93c-3ea8-4e55-9a42-5db856dcb138 for instance 31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed on hv-cinder-83538 Aug 26 01:02:23.239322 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [req-b0414a03-2de3-45a9-890d-5e697cc5469a req-cd8fe33a-2fe6-43b3-b70d-915c55c666a7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032874 Aug 26 01:02:23.239927 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 460/914] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 01:02:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:02:23.469757 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-30377055-6b85-4082-91b7-6c67a3ccd60d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:02:23.470372 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-30377055-6b85-4082-91b7-6c67a3ccd60d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: 3955819b-d03a-4684-aba7-5d485c66a29e] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:02:23.477058 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-30377055-6b85-4082-91b7-6c67a3ccd60d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:23.477544 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-30377055-6b85-4082-91b7-6c67a3ccd60d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:23.477977 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-30377055-6b85-4082-91b7-6c67a3ccd60d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:23.478665 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-30377055-6b85-4082-91b7-6c67a3ccd60d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:23.479139 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-30377055-6b85-4082-91b7-6c67a3ccd60d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:23.479561 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-30377055-6b85-4082-91b7-6c67a3ccd60d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:23.649054 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-30377055-6b85-4082-91b7-6c67a3ccd60d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38047508b7d44f05af7116a15ba7e319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b021c415a147e08dbfede2ddc8cc27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:02:23.658057 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-30377055-6b85-4082-91b7-6c67a3ccd60d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/3955819b-d03a-4684-aba7-5d485c66a29e" status: 200 len: 1365 microversion: 2.1 time: 0.192070 Aug 26 01:02:23.659118 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 455/915] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:02:23 2022] GET /compute/v2.1/servers/3955819b-d03a-4684-aba7-5d485c66a29e => generated 1365 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:02:24.680931 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-356ddb4b-9419-462e-9fa0-c32f602a3091 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:02:24.681632 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-356ddb4b-9419-462e-9fa0-c32f602a3091 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: 3955819b-d03a-4684-aba7-5d485c66a29e] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:02:24.688166 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-356ddb4b-9419-462e-9fa0-c32f602a3091 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:24.688642 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-356ddb4b-9419-462e-9fa0-c32f602a3091 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:24.689083 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-356ddb4b-9419-462e-9fa0-c32f602a3091 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:24.689773 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-356ddb4b-9419-462e-9fa0-c32f602a3091 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:24.690228 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-356ddb4b-9419-462e-9fa0-c32f602a3091 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:24.690654 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-356ddb4b-9419-462e-9fa0-c32f602a3091 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:24.821925 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-356ddb4b-9419-462e-9fa0-c32f602a3091 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38047508b7d44f05af7116a15ba7e319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b021c415a147e08dbfede2ddc8cc27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:02:24.830264 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-356ddb4b-9419-462e-9fa0-c32f602a3091 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/3955819b-d03a-4684-aba7-5d485c66a29e" status: 200 len: 1555 microversion: 2.1 time: 0.154703 Aug 26 01:02:24.830829 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 461/916] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:02:24 2022] GET /compute/v2.1/servers/3955819b-d03a-4684-aba7-5d485c66a29e => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:02:24.850866 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-a1e1dcc8-2085-4643-a9ad-ac6bcf9b7e72 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:02:24.851431 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-a1e1dcc8-2085-4643-a9ad-ac6bcf9b7e72 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: 3955819b-d03a-4684-aba7-5d485c66a29e] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:02:24.853780 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=6 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:02:24.859440 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a1e1dcc8-2085-4643-a9ad-ac6bcf9b7e72 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:24.859938 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a1e1dcc8-2085-4643-a9ad-ac6bcf9b7e72 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:24.860380 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a1e1dcc8-2085-4643-a9ad-ac6bcf9b7e72 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:24.861151 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a1e1dcc8-2085-4643-a9ad-ac6bcf9b7e72 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:24.861577 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a1e1dcc8-2085-4643-a9ad-ac6bcf9b7e72 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:24.862001 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a1e1dcc8-2085-4643-a9ad-ac6bcf9b7e72 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:24.948017 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-a1e1dcc8-2085-4643-a9ad-ac6bcf9b7e72 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/3955819b-d03a-4684-aba7-5d485c66a29e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100988 Aug 26 01:02:24.948630 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 456/917] 10.222.0.59 () {58 vars in 1275 bytes} [Fri Aug 26 01:02:24 2022] GET /compute/v2.1/servers/3955819b-d03a-4684-aba7-5d485c66a29e/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:02:25.956091 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [req-a558afde-6b1e-4fb6-a9bc-5d1325dad3d3 req-c240fd36-74e7-44ea-81b3-a973fed5c246 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3955819b-d03a-4684-aba7-5d485c66a29e", "tag": "66599df3-70a8-4a2f-b18a-a34433739290"}]} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:02:25.961727 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=2 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:02:25.968223 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-a558afde-6b1e-4fb6-a9bc-5d1325dad3d3 req-c240fd36-74e7-44ea-81b3-a973fed5c246 service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:25.968732 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-a558afde-6b1e-4fb6-a9bc-5d1325dad3d3 req-c240fd36-74e7-44ea-81b3-a973fed5c246 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:25.969387 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-a558afde-6b1e-4fb6-a9bc-5d1325dad3d3 req-c240fd36-74e7-44ea-81b3-a973fed5c246 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:25.981022 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.compute.server_external_events [req-a558afde-6b1e-4fb6-a9bc-5d1325dad3d3 req-c240fd36-74e7-44ea-81b3-a973fed5c246 service nova] Creating event network-changed:66599df3-70a8-4a2f-b18a-a34433739290 for instance 3955819b-d03a-4684-aba7-5d485c66a29e on hv-cinder-83538 Aug 26 01:02:25.994556 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [req-a558afde-6b1e-4fb6-a9bc-5d1325dad3d3 req-c240fd36-74e7-44ea-81b3-a973fed5c246 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041988 Aug 26 01:02:25.995244 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 462/918] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 01:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 01:02:27.055580 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-a8e15768-dcc0-4d9a-b704-b676c9c112fe tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-771722906", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1155807456", "security_groups": [{"name": "tempest-secgroup-smoke-1087164614"}], "networks": [{"uuid": "72a1a80f-93a4-4c90-a775-5c4f6bbbd908"}], "block_device_mapping_v2": [{"uuid": "23e95160-d09c-41f1-92eb-f7ce6c2e5fe1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:02:27.170454 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.network.neutron [None req-a8e15768-dcc0-4d9a-b704-b676c9c112fe tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] validate_networks() for [('72a1a80f-93a4-4c90-a775-5c4f6bbbd908', None, None, None, None, None)] {{(pid=127565) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 01:02:27.553355 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.virt.hardware [None req-a8e15768-dcc0-4d9a-b704-b676c9c112fe tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Flavor limits 0:0:0 {{(pid=127565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 01:02:27.553780 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.virt.hardware [None req-a8e15768-dcc0-4d9a-b704-b676c9c112fe tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Image limits 0:0:0 {{(pid=127565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 01:02:27.554250 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.virt.hardware [None req-a8e15768-dcc0-4d9a-b704-b676c9c112fe tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Flavor pref 0:0:0 {{(pid=127565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 01:02:27.554698 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.virt.hardware [None req-a8e15768-dcc0-4d9a-b704-b676c9c112fe tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Image pref 0:0:0 {{(pid=127565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 01:02:27.555107 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.virt.hardware [None req-a8e15768-dcc0-4d9a-b704-b676c9c112fe tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 01:02:27.564548 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a8e15768-dcc0-4d9a-b704-b676c9c112fe tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:27.565030 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a8e15768-dcc0-4d9a-b704-b676c9c112fe tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:27.565465 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a8e15768-dcc0-4d9a-b704-b676c9c112fe tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:27.566189 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a8e15768-dcc0-4d9a-b704-b676c9c112fe tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:27.566645 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a8e15768-dcc0-4d9a-b704-b676c9c112fe tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:27.567067 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a8e15768-dcc0-4d9a-b704-b676c9c112fe tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:27.585584 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.quota [None req-a8e15768-dcc0-4d9a-b704-b676c9c112fe tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Getting quotas for project a223be1c2f6a4cd281b20b0bc7281554. Resources: {'instances', 'ram', 'cores'} {{(pid=127565) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 01:02:27.589718 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.quota [None req-a8e15768-dcc0-4d9a-b704-b676c9c112fe tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Getting quotas for user 83076e7b11fb446ca50f23fe8e6e7ab6 and project a223be1c2f6a4cd281b20b0bc7281554. Resources: {'instances', 'ram', 'cores'} {{(pid=127565) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 01:02:27.656349 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-a8e15768-dcc0-4d9a-b704-b676c9c112fe tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Going to run 1 instances... {{(pid=127565) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 01:02:27.658516 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-a8e15768-dcc0-4d9a-b704-b676c9c112fe tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] [instance: d63711c4-8adf-43bd-9822-b8f82055f35f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='23e95160-d09c-41f1-92eb-f7ce6c2e5fe1',volume_size=None,volume_type=None)] {{(pid=127565) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 01:02:28.082477 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-a8e15768-dcc0-4d9a-b704-b676c9c112fe tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.031397 Aug 26 01:02:28.088539 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 457/919] 10.222.0.59 () {60 vars in 1147 bytes} [Fri Aug 26 01:02:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 1033 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 01:02:28.095238 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-764f4850-e67b-4cfe-ac66-12f15135a90b tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:02:28.095963 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-764f4850-e67b-4cfe-ac66-12f15135a90b tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] [instance: d63711c4-8adf-43bd-9822-b8f82055f35f] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:02:28.152056 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-764f4850-e67b-4cfe-ac66-12f15135a90b tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83076e7b11fb446ca50f23fe8e6e7ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a223be1c2f6a4cd281b20b0bc7281554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:02:28.159587 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-764f4850-e67b-4cfe-ac66-12f15135a90b tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] 10.222.0.59 "GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f" status: 200 len: 1088 microversion: 2.1 time: 0.069220 Aug 26 01:02:28.170720 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 463/920] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:02:28 2022] GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f => generated 1088 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:02:29.180627 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-aebe1ad0-80b8-4e69-877f-1bf35b21fe0f tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:02:29.181255 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-aebe1ad0-80b8-4e69-877f-1bf35b21fe0f tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] [instance: d63711c4-8adf-43bd-9822-b8f82055f35f] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:02:29.236927 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-aebe1ad0-80b8-4e69-877f-1bf35b21fe0f tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83076e7b11fb446ca50f23fe8e6e7ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a223be1c2f6a4cd281b20b0bc7281554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:02:29.244066 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-aebe1ad0-80b8-4e69-877f-1bf35b21fe0f tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] 10.222.0.59 "GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f" status: 200 len: 1088 microversion: 2.1 time: 0.068079 Aug 26 01:02:29.244647 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 458/921] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:02:29 2022] GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f => generated 1088 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:02:30.266624 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-65b2b971-c4e9-4cda-94ee-5228e543798c tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:02:30.267237 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-65b2b971-c4e9-4cda-94ee-5228e543798c tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] [instance: d63711c4-8adf-43bd-9822-b8f82055f35f] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:02:30.274095 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-65b2b971-c4e9-4cda-94ee-5228e543798c tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:30.274582 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-65b2b971-c4e9-4cda-94ee-5228e543798c tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:30.275018 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-65b2b971-c4e9-4cda-94ee-5228e543798c tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:30.275713 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-65b2b971-c4e9-4cda-94ee-5228e543798c tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:30.276169 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-65b2b971-c4e9-4cda-94ee-5228e543798c tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:30.276627 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-65b2b971-c4e9-4cda-94ee-5228e543798c tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:30.347432 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-65b2b971-c4e9-4cda-94ee-5228e543798c tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83076e7b11fb446ca50f23fe8e6e7ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a223be1c2f6a4cd281b20b0bc7281554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:02:30.355723 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-65b2b971-c4e9-4cda-94ee-5228e543798c tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] 10.222.0.59 "GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f" status: 200 len: 1186 microversion: 2.1 time: 0.093805 Aug 26 01:02:30.356279 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 464/922] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:02:30 2022] GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f => generated 1186 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:02:31.377100 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-f5e85212-07b9-4b42-b9d1-980f4a1ae5ed tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:02:31.377829 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-f5e85212-07b9-4b42-b9d1-980f4a1ae5ed tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] [instance: d63711c4-8adf-43bd-9822-b8f82055f35f] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:02:31.384936 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f5e85212-07b9-4b42-b9d1-980f4a1ae5ed tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:31.385422 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f5e85212-07b9-4b42-b9d1-980f4a1ae5ed tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:31.385860 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f5e85212-07b9-4b42-b9d1-980f4a1ae5ed tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:31.386564 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f5e85212-07b9-4b42-b9d1-980f4a1ae5ed tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:31.387022 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f5e85212-07b9-4b42-b9d1-980f4a1ae5ed tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:31.387449 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f5e85212-07b9-4b42-b9d1-980f4a1ae5ed tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:31.450180 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-f5e85212-07b9-4b42-b9d1-980f4a1ae5ed tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83076e7b11fb446ca50f23fe8e6e7ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a223be1c2f6a4cd281b20b0bc7281554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:02:31.459060 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-f5e85212-07b9-4b42-b9d1-980f4a1ae5ed tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] 10.222.0.59 "GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f" status: 200 len: 1204 microversion: 2.1 time: 0.086458 Aug 26 01:02:31.459687 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 459/923] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:02:31 2022] GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f => generated 1204 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 01:02:32.479075 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-e813e9d8-9636-4649-bea6-2bc2c1bb9b7a tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:02:32.479872 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-e813e9d8-9636-4649-bea6-2bc2c1bb9b7a tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] [instance: d63711c4-8adf-43bd-9822-b8f82055f35f] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:02:32.487460 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e813e9d8-9636-4649-bea6-2bc2c1bb9b7a tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:32.487941 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e813e9d8-9636-4649-bea6-2bc2c1bb9b7a tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:32.488373 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e813e9d8-9636-4649-bea6-2bc2c1bb9b7a tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:32.489159 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e813e9d8-9636-4649-bea6-2bc2c1bb9b7a tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:32.489659 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e813e9d8-9636-4649-bea6-2bc2c1bb9b7a tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:32.490084 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e813e9d8-9636-4649-bea6-2bc2c1bb9b7a tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:32.595826 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [req-c4bdd93e-a090-469c-9e86-6dc446aa9de9 req-9cfd02a3-d243-4813-8065-d3f0fc3ed9b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d63711c4-8adf-43bd-9822-b8f82055f35f", "tag": "8d821bb5-fb83-42d7-b1c5-f97cf0d2ca3f"}]} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:02:32.607618 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-c4bdd93e-a090-469c-9e86-6dc446aa9de9 req-9cfd02a3-d243-4813-8065-d3f0fc3ed9b5 service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:32.608128 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-c4bdd93e-a090-469c-9e86-6dc446aa9de9 req-9cfd02a3-d243-4813-8065-d3f0fc3ed9b5 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:32.608586 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-c4bdd93e-a090-469c-9e86-6dc446aa9de9 req-9cfd02a3-d243-4813-8065-d3f0fc3ed9b5 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:32.619572 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.compute.server_external_events [req-c4bdd93e-a090-469c-9e86-6dc446aa9de9 req-9cfd02a3-d243-4813-8065-d3f0fc3ed9b5 service nova] Creating event network-changed:8d821bb5-fb83-42d7-b1c5-f97cf0d2ca3f for instance d63711c4-8adf-43bd-9822-b8f82055f35f on hv-cinder-83538 Aug 26 01:02:32.625112 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [req-c4bdd93e-a090-469c-9e86-6dc446aa9de9 req-9cfd02a3-d243-4813-8065-d3f0fc3ed9b5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032839 Aug 26 01:02:32.625895 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 460/924] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 01:02:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:02:32.676509 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-e813e9d8-9636-4649-bea6-2bc2c1bb9b7a tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83076e7b11fb446ca50f23fe8e6e7ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a223be1c2f6a4cd281b20b0bc7281554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:02:32.688954 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-e813e9d8-9636-4649-bea6-2bc2c1bb9b7a tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] 10.222.0.59 "GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f" status: 200 len: 1272 microversion: 2.1 time: 0.213340 Aug 26 01:02:32.690239 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 465/925] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:02:32 2022] GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f => generated 1272 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:02:33.717792 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-405a4570-484b-4648-bb1f-b35342e90950 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:02:33.718605 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-405a4570-484b-4648-bb1f-b35342e90950 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] [instance: d63711c4-8adf-43bd-9822-b8f82055f35f] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:02:33.724863 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-405a4570-484b-4648-bb1f-b35342e90950 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:33.725419 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-405a4570-484b-4648-bb1f-b35342e90950 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:33.725921 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-405a4570-484b-4648-bb1f-b35342e90950 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:33.726678 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-405a4570-484b-4648-bb1f-b35342e90950 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:33.727221 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-405a4570-484b-4648-bb1f-b35342e90950 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:33.727719 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-405a4570-484b-4648-bb1f-b35342e90950 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:33.877542 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-405a4570-484b-4648-bb1f-b35342e90950 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83076e7b11fb446ca50f23fe8e6e7ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a223be1c2f6a4cd281b20b0bc7281554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:02:33.885573 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-405a4570-484b-4648-bb1f-b35342e90950 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] 10.222.0.59 "GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f" status: 200 len: 1260 microversion: 2.1 time: 0.172974 Aug 26 01:02:33.886074 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 461/926] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:02:33 2022] GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:02:34.907671 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-ca529514-2437-4b56-b61e-c4f628c42a32 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:02:34.908285 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-ca529514-2437-4b56-b61e-c4f628c42a32 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] [instance: d63711c4-8adf-43bd-9822-b8f82055f35f] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:02:34.915226 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ca529514-2437-4b56-b61e-c4f628c42a32 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:34.915707 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ca529514-2437-4b56-b61e-c4f628c42a32 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:34.916141 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ca529514-2437-4b56-b61e-c4f628c42a32 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:34.916865 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ca529514-2437-4b56-b61e-c4f628c42a32 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:34.917321 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ca529514-2437-4b56-b61e-c4f628c42a32 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:34.917744 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ca529514-2437-4b56-b61e-c4f628c42a32 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:35.052539 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-ca529514-2437-4b56-b61e-c4f628c42a32 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83076e7b11fb446ca50f23fe8e6e7ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a223be1c2f6a4cd281b20b0bc7281554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:02:35.053935 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-ca529514-2437-4b56-b61e-c4f628c42a32 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] 10.222.0.59 "GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f" status: 200 len: 1260 microversion: 2.1 time: 0.150740 Aug 26 01:02:35.054496 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 466/927] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:02:34 2022] GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:02:36.074014 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-b4c0ccf5-239e-4f43-92a8-929e8a29682f tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:02:36.074634 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-b4c0ccf5-239e-4f43-92a8-929e8a29682f tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] [instance: d63711c4-8adf-43bd-9822-b8f82055f35f] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:02:36.081329 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b4c0ccf5-239e-4f43-92a8-929e8a29682f tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:36.081816 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b4c0ccf5-239e-4f43-92a8-929e8a29682f tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:36.082256 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b4c0ccf5-239e-4f43-92a8-929e8a29682f tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:36.082951 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b4c0ccf5-239e-4f43-92a8-929e8a29682f tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:36.083432 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b4c0ccf5-239e-4f43-92a8-929e8a29682f tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:36.083862 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b4c0ccf5-239e-4f43-92a8-929e8a29682f tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:36.213969 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-b4c0ccf5-239e-4f43-92a8-929e8a29682f tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83076e7b11fb446ca50f23fe8e6e7ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a223be1c2f6a4cd281b20b0bc7281554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:02:36.222199 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-b4c0ccf5-239e-4f43-92a8-929e8a29682f tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] 10.222.0.59 "GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f" status: 200 len: 1260 microversion: 2.1 time: 0.152088 Aug 26 01:02:36.222765 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 462/928] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:02:36 2022] GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:02:37.242746 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-5c894fea-0564-4734-b1a0-34c91ca93b9c tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:02:37.243363 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-5c894fea-0564-4734-b1a0-34c91ca93b9c tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] [instance: d63711c4-8adf-43bd-9822-b8f82055f35f] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:02:37.250388 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5c894fea-0564-4734-b1a0-34c91ca93b9c tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:37.250874 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5c894fea-0564-4734-b1a0-34c91ca93b9c tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:37.251314 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5c894fea-0564-4734-b1a0-34c91ca93b9c tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:37.252009 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5c894fea-0564-4734-b1a0-34c91ca93b9c tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:37.252463 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5c894fea-0564-4734-b1a0-34c91ca93b9c tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:37.252942 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5c894fea-0564-4734-b1a0-34c91ca93b9c tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:37.385450 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-5c894fea-0564-4734-b1a0-34c91ca93b9c tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83076e7b11fb446ca50f23fe8e6e7ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a223be1c2f6a4cd281b20b0bc7281554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:02:37.393085 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-5c894fea-0564-4734-b1a0-34c91ca93b9c tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] 10.222.0.59 "GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f" status: 200 len: 1260 microversion: 2.1 time: 0.154229 Aug 26 01:02:37.393799 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 467/929] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:02:37 2022] GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:02:38.414456 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-c693f6c2-4134-477b-a245-17e873b11e42 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:02:38.415065 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-c693f6c2-4134-477b-a245-17e873b11e42 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] [instance: d63711c4-8adf-43bd-9822-b8f82055f35f] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:02:38.417627 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell0:SELECT=2 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:02:38.423174 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c693f6c2-4134-477b-a245-17e873b11e42 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:38.423725 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c693f6c2-4134-477b-a245-17e873b11e42 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:38.424160 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c693f6c2-4134-477b-a245-17e873b11e42 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:38.425099 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c693f6c2-4134-477b-a245-17e873b11e42 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:38.425620 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c693f6c2-4134-477b-a245-17e873b11e42 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:38.426046 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c693f6c2-4134-477b-a245-17e873b11e42 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:38.561167 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-c693f6c2-4134-477b-a245-17e873b11e42 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83076e7b11fb446ca50f23fe8e6e7ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a223be1c2f6a4cd281b20b0bc7281554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:02:38.568819 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-c693f6c2-4134-477b-a245-17e873b11e42 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] 10.222.0.59 "GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f" status: 200 len: 1260 microversion: 2.1 time: 0.158415 Aug 26 01:02:38.569379 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 463/930] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:02:38 2022] GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:02:39.589486 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-29e47c31-14f4-48b8-b23a-144e1c8e9dad tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:02:39.590023 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-29e47c31-14f4-48b8-b23a-144e1c8e9dad tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] [instance: d63711c4-8adf-43bd-9822-b8f82055f35f] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:02:39.592063 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell0:SELECT=2 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:02:39.597452 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-29e47c31-14f4-48b8-b23a-144e1c8e9dad tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:39.597934 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-29e47c31-14f4-48b8-b23a-144e1c8e9dad tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:39.598372 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-29e47c31-14f4-48b8-b23a-144e1c8e9dad tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:39.599069 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-29e47c31-14f4-48b8-b23a-144e1c8e9dad tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:39.599522 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-29e47c31-14f4-48b8-b23a-144e1c8e9dad tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:39.599947 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-29e47c31-14f4-48b8-b23a-144e1c8e9dad tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:39.737347 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-29e47c31-14f4-48b8-b23a-144e1c8e9dad tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83076e7b11fb446ca50f23fe8e6e7ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a223be1c2f6a4cd281b20b0bc7281554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:02:39.745021 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-29e47c31-14f4-48b8-b23a-144e1c8e9dad tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] 10.222.0.59 "GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f" status: 200 len: 1260 microversion: 2.1 time: 0.159523 Aug 26 01:02:39.745591 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 468/931] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:02:39 2022] GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:02:40.766733 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-47a011d3-6541-43c5-b3dc-bbf8a0814dd2 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:02:40.767357 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-47a011d3-6541-43c5-b3dc-bbf8a0814dd2 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] [instance: d63711c4-8adf-43bd-9822-b8f82055f35f] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:02:40.769209 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell0:SELECT=8 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:02:40.774831 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-47a011d3-6541-43c5-b3dc-bbf8a0814dd2 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:40.775316 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-47a011d3-6541-43c5-b3dc-bbf8a0814dd2 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:40.775756 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-47a011d3-6541-43c5-b3dc-bbf8a0814dd2 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:40.776487 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-47a011d3-6541-43c5-b3dc-bbf8a0814dd2 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:40.776948 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-47a011d3-6541-43c5-b3dc-bbf8a0814dd2 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:40.777374 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-47a011d3-6541-43c5-b3dc-bbf8a0814dd2 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:40.908074 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-47a011d3-6541-43c5-b3dc-bbf8a0814dd2 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83076e7b11fb446ca50f23fe8e6e7ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a223be1c2f6a4cd281b20b0bc7281554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:02:40.915925 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-47a011d3-6541-43c5-b3dc-bbf8a0814dd2 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] 10.222.0.59 "GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f" status: 200 len: 1260 microversion: 2.1 time: 0.153678 Aug 26 01:02:40.916525 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 464/932] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:02:40 2022] GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:02:41.936714 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-77b09890-edb3-4620-a34e-300a7f159f81 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:02:41.937325 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-77b09890-edb3-4620-a34e-300a7f159f81 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] [instance: d63711c4-8adf-43bd-9822-b8f82055f35f] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:02:41.943761 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-77b09890-edb3-4620-a34e-300a7f159f81 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:41.944242 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-77b09890-edb3-4620-a34e-300a7f159f81 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:41.944709 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-77b09890-edb3-4620-a34e-300a7f159f81 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:41.945400 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-77b09890-edb3-4620-a34e-300a7f159f81 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:41.945849 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-77b09890-edb3-4620-a34e-300a7f159f81 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:41.946270 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-77b09890-edb3-4620-a34e-300a7f159f81 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:42.086233 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-77b09890-edb3-4620-a34e-300a7f159f81 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83076e7b11fb446ca50f23fe8e6e7ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a223be1c2f6a4cd281b20b0bc7281554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:02:42.093841 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-77b09890-edb3-4620-a34e-300a7f159f81 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] 10.222.0.59 "GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f" status: 200 len: 1260 microversion: 2.1 time: 0.161576 Aug 26 01:02:42.094407 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 469/933] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:02:41 2022] GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:02:43.114082 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-40dbac64-dff2-4e5d-81be-f8ff623bafb8 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:02:43.114685 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-40dbac64-dff2-4e5d-81be-f8ff623bafb8 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] [instance: d63711c4-8adf-43bd-9822-b8f82055f35f] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:02:43.121165 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-40dbac64-dff2-4e5d-81be-f8ff623bafb8 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:43.121622 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-40dbac64-dff2-4e5d-81be-f8ff623bafb8 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:43.122054 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-40dbac64-dff2-4e5d-81be-f8ff623bafb8 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:43.122758 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-40dbac64-dff2-4e5d-81be-f8ff623bafb8 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:43.123317 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-40dbac64-dff2-4e5d-81be-f8ff623bafb8 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:43.123614 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-40dbac64-dff2-4e5d-81be-f8ff623bafb8 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:43.259021 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-40dbac64-dff2-4e5d-81be-f8ff623bafb8 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83076e7b11fb446ca50f23fe8e6e7ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a223be1c2f6a4cd281b20b0bc7281554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:02:43.267478 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-40dbac64-dff2-4e5d-81be-f8ff623bafb8 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] 10.222.0.59 "GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f" status: 200 len: 1260 microversion: 2.1 time: 0.156536 Aug 26 01:02:43.267478 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 465/934] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:02:43 2022] GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:02:43.358819 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [req-93535af7-920b-42dc-a263-2cfeb6ed7200 req-18ebe39c-b03b-4a13-82d2-6db31d742255 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d63711c4-8adf-43bd-9822-b8f82055f35f", "name": "network-vif-plugged", "status": "completed", "tag": "8d821bb5-fb83-42d7-b1c5-f97cf0d2ca3f"}]} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:02:43.368818 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-93535af7-920b-42dc-a263-2cfeb6ed7200 req-18ebe39c-b03b-4a13-82d2-6db31d742255 service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:43.369292 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-93535af7-920b-42dc-a263-2cfeb6ed7200 req-18ebe39c-b03b-4a13-82d2-6db31d742255 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:43.369717 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-93535af7-920b-42dc-a263-2cfeb6ed7200 req-18ebe39c-b03b-4a13-82d2-6db31d742255 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:43.380637 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.compute.server_external_events [req-93535af7-920b-42dc-a263-2cfeb6ed7200 req-18ebe39c-b03b-4a13-82d2-6db31d742255 service nova] Creating event network-vif-plugged:8d821bb5-fb83-42d7-b1c5-f97cf0d2ca3f for instance d63711c4-8adf-43bd-9822-b8f82055f35f on hv-cinder-83538 Aug 26 01:02:43.385855 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [req-93535af7-920b-42dc-a263-2cfeb6ed7200 req-18ebe39c-b03b-4a13-82d2-6db31d742255 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030678 Aug 26 01:02:43.389906 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 470/935] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 01:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:02:44.287647 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-041f9249-dc6e-464b-9bcd-1abad40b6fe0 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:02:44.288190 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-041f9249-dc6e-464b-9bcd-1abad40b6fe0 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] [instance: d63711c4-8adf-43bd-9822-b8f82055f35f] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:02:44.294592 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-041f9249-dc6e-464b-9bcd-1abad40b6fe0 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:44.295071 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-041f9249-dc6e-464b-9bcd-1abad40b6fe0 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:44.295497 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-041f9249-dc6e-464b-9bcd-1abad40b6fe0 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:44.296170 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-041f9249-dc6e-464b-9bcd-1abad40b6fe0 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:44.296647 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-041f9249-dc6e-464b-9bcd-1abad40b6fe0 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:44.297061 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-041f9249-dc6e-464b-9bcd-1abad40b6fe0 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:44.429901 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-041f9249-dc6e-464b-9bcd-1abad40b6fe0 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83076e7b11fb446ca50f23fe8e6e7ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a223be1c2f6a4cd281b20b0bc7281554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:02:44.438254 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-041f9249-dc6e-464b-9bcd-1abad40b6fe0 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] 10.222.0.59 "GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f" status: 200 len: 1260 microversion: 2.1 time: 0.154756 Aug 26 01:02:44.439222 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 466/936] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:02:44 2022] GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:02:45.461575 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-27e1e0cd-5763-4b2c-b2f6-58771eef8e2a tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:02:45.462272 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-27e1e0cd-5763-4b2c-b2f6-58771eef8e2a tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] [instance: d63711c4-8adf-43bd-9822-b8f82055f35f] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:02:45.469473 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-27e1e0cd-5763-4b2c-b2f6-58771eef8e2a tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:45.470357 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-27e1e0cd-5763-4b2c-b2f6-58771eef8e2a tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:45.470802 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-27e1e0cd-5763-4b2c-b2f6-58771eef8e2a tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:45.471711 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-27e1e0cd-5763-4b2c-b2f6-58771eef8e2a tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:45.472193 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-27e1e0cd-5763-4b2c-b2f6-58771eef8e2a tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:45.472647 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-27e1e0cd-5763-4b2c-b2f6-58771eef8e2a tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:45.605806 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-27e1e0cd-5763-4b2c-b2f6-58771eef8e2a tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83076e7b11fb446ca50f23fe8e6e7ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a223be1c2f6a4cd281b20b0bc7281554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:02:45.613597 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-27e1e0cd-5763-4b2c-b2f6-58771eef8e2a tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] 10.222.0.59 "GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f" status: 200 len: 1260 microversion: 2.1 time: 0.156697 Aug 26 01:02:45.614157 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 471/937] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:02:45 2022] GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:02:46.633185 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-621a949f-363a-4631-8f4d-21ebd5361df3 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:02:46.633802 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-621a949f-363a-4631-8f4d-21ebd5361df3 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] [instance: d63711c4-8adf-43bd-9822-b8f82055f35f] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:02:46.640782 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-621a949f-363a-4631-8f4d-21ebd5361df3 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:46.641260 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-621a949f-363a-4631-8f4d-21ebd5361df3 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:46.641688 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-621a949f-363a-4631-8f4d-21ebd5361df3 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:46.642371 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-621a949f-363a-4631-8f4d-21ebd5361df3 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:46.642820 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-621a949f-363a-4631-8f4d-21ebd5361df3 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:46.643239 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-621a949f-363a-4631-8f4d-21ebd5361df3 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:46.770732 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-621a949f-363a-4631-8f4d-21ebd5361df3 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83076e7b11fb446ca50f23fe8e6e7ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a223be1c2f6a4cd281b20b0bc7281554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:02:46.778534 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-621a949f-363a-4631-8f4d-21ebd5361df3 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] 10.222.0.59 "GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f" status: 200 len: 1443 microversion: 2.1 time: 0.149229 Aug 26 01:02:46.779099 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 467/938] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:02:46 2022] GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f => generated 1443 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:02:46.798284 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-ac736538-cf55-4f31-a7a3-636ec6198d18 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:02:46.798895 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-ac736538-cf55-4f31-a7a3-636ec6198d18 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] [instance: d63711c4-8adf-43bd-9822-b8f82055f35f] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:02:46.805336 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ac736538-cf55-4f31-a7a3-636ec6198d18 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:46.805817 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ac736538-cf55-4f31-a7a3-636ec6198d18 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:46.806251 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ac736538-cf55-4f31-a7a3-636ec6198d18 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:46.806946 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ac736538-cf55-4f31-a7a3-636ec6198d18 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:46.807400 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ac736538-cf55-4f31-a7a3-636ec6198d18 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:46.807824 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ac736538-cf55-4f31-a7a3-636ec6198d18 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:46.943162 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-ac736538-cf55-4f31-a7a3-636ec6198d18 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83076e7b11fb446ca50f23fe8e6e7ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a223be1c2f6a4cd281b20b0bc7281554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:02:46.951474 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-ac736538-cf55-4f31-a7a3-636ec6198d18 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] 10.222.0.59 "GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f" status: 200 len: 1443 microversion: 2.1 time: 0.156511 Aug 26 01:02:46.952039 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 472/939] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:02:46 2022] GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f => generated 1443 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:02:48.932237 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [req-37d35f40-43b2-4057-8377-f48c167a2da4 req-ed1de4c0-7488-4972-8d4a-58071640c959 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d63711c4-8adf-43bd-9822-b8f82055f35f", "tag": "8d821bb5-fb83-42d7-b1c5-f97cf0d2ca3f"}]} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:02:48.942670 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-37d35f40-43b2-4057-8377-f48c167a2da4 req-ed1de4c0-7488-4972-8d4a-58071640c959 service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:02:48.943228 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-37d35f40-43b2-4057-8377-f48c167a2da4 req-ed1de4c0-7488-4972-8d4a-58071640c959 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:02:48.943736 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-37d35f40-43b2-4057-8377-f48c167a2da4 req-ed1de4c0-7488-4972-8d4a-58071640c959 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:02:48.955504 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.compute.server_external_events [req-37d35f40-43b2-4057-8377-f48c167a2da4 req-ed1de4c0-7488-4972-8d4a-58071640c959 service nova] Creating event network-changed:8d821bb5-fb83-42d7-b1c5-f97cf0d2ca3f for instance d63711c4-8adf-43bd-9822-b8f82055f35f on hv-cinder-83538 Aug 26 01:02:48.960621 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [req-37d35f40-43b2-4057-8377-f48c167a2da4 req-ed1de4c0-7488-4972-8d4a-58071640c959 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032306 Aug 26 01:02:48.961273 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 468/940] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 01:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:03:02.115841 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-98bdbae2-d449-422f-bd8f-459f55df21a9 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:03:02.116380 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-98bdbae2-d449-422f-bd8f-459f55df21a9 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: 3955819b-d03a-4684-aba7-5d485c66a29e] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:03:02.118560 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_api:SELECT=23 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:03:02.119203 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell1:SELECT=62 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:03:02.124281 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-98bdbae2-d449-422f-bd8f-459f55df21a9 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:02.124798 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-98bdbae2-d449-422f-bd8f-459f55df21a9 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:02.125236 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-98bdbae2-d449-422f-bd8f-459f55df21a9 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:02.125928 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-98bdbae2-d449-422f-bd8f-459f55df21a9 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:02.126364 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-98bdbae2-d449-422f-bd8f-459f55df21a9 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:02.126786 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-98bdbae2-d449-422f-bd8f-459f55df21a9 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:02.149924 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-98bdbae2-d449-422f-bd8f-459f55df21a9 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/3955819b-d03a-4684-aba7-5d485c66a29e/ips" status: 200 len: 150 microversion: 2.1 time: 0.037934 Aug 26 01:03:02.150477 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 473/941] 10.222.0.59 () {58 vars in 1248 bytes} [Fri Aug 26 01:03:02 2022] GET /compute/v2.1/servers/3955819b-d03a-4684-aba7-5d485c66a29e/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:03:02.159527 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:03:02.166295 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell1:SELECT=84 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:03:02.166295 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-511d8c48-fe26-4c38-9ce2-a5183ed91707 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f6116700-aeb2-4fc5-909a-d95b9b4ea02d"}} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:03:02.167224 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-511d8c48-fe26-4c38-9ce2-a5183ed91707 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: 3955819b-d03a-4684-aba7-5d485c66a29e] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:03:02.173255 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-511d8c48-fe26-4c38-9ce2-a5183ed91707 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:02.173728 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-511d8c48-fe26-4c38-9ce2-a5183ed91707 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:02.174198 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-511d8c48-fe26-4c38-9ce2-a5183ed91707 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:02.174874 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-511d8c48-fe26-4c38-9ce2-a5183ed91707 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:02.175316 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-511d8c48-fe26-4c38-9ce2-a5183ed91707 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:02.175732 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-511d8c48-fe26-4c38-9ce2-a5183ed91707 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:02.254458 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.wsgi [None req-511d8c48-fe26-4c38-9ce2-a5183ed91707 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] HTTP exception thrown: Invalid volume: volume f6116700-aeb2-4fc5-909a-d95b9b4ea02d is already attached to instances: f432be84-f338-4303-86a0-a45611eb0850 Aug 26 01:03:02.256190 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-511d8c48-fe26-4c38-9ce2-a5183ed91707 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Request method failure captured: Aug 26 01:03:02.256190 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: request: POST /compute/v2.1/servers/3955819b-d03a-4684-aba7-5d485c66a29e/os-volume_attachments HTTP/1.1 Aug 26 01:03:02.256190 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Accept: application/json Aug 26 01:03:02.256190 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Accept-Encoding: identity Aug 26 01:03:02.256190 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Connection: close Aug 26 01:03:02.256190 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Content-Length: 74 Aug 26 01:03:02.256190 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Content-Type: application/json Aug 26 01:03:02.256190 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Host: 10.222.0.59 Aug 26 01:03:02.256190 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Openstack-System-Scope: None Aug 26 01:03:02.256190 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: User-Agent: python-urllib3/1.26.11 Aug 26 01:03:02.256190 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Auth-Token: gAAAAABjCBtKv7Ptmn6ODyXcqDwiO_uQzh6mqyqflGy1xdbBhbXPxieO4RSPPFbB4mQUaGf6pIM59uQGaWkpT_lu6RdlUkkLPi08g2IwRrKssv3K5sM8xJTV55LE3mg5hFUUhkTXeZla8aTh4ipX4VYHFhrTqhydw3qJT6H_hFgb5jrawb0wsSk Aug 26 01:03:02.256190 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Domain-Id: None Aug 26 01:03:02.256190 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Domain-Name: None Aug 26 01:03:02.256190 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Identity-Status: Confirmed Aug 26 01:03:02.256190 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Is-Admin-Project: True Aug 26 01:03:02.256190 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Domain-Id: default Aug 26 01:03:02.256190 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Domain-Name: Default Aug 26 01:03:02.256190 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Id: 03b021c415a147e08dbfede2ddc8cc27 Aug 26 01:03:02.256190 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Name: tempest-AttachVolumeNegativeTest-1692640927 Aug 26 01:03:02.256190 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Role: reader,member Aug 26 01:03:02.256190 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Roles: reader,member Aug 26 01:03:02.258049 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_03b021c415a147e08dbfede2ddc8cc27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/03b021c415a147e08dbfede2ddc8cc27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/03b021c415a147e08dbfede2ddc8cc27"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/03b021c415a147e08dbfede2ddc8cc27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 01:03:02.258049 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant: tempest-AttachVolumeNegativeTest-1692640927 Aug 26 01:03:02.258049 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant-Id: 03b021c415a147e08dbfede2ddc8cc27 Aug 26 01:03:02.258049 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1692640927 Aug 26 01:03:02.258049 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User: tempest-AttachVolumeNegativeTest-1692640927-project Aug 26 01:03:02.258049 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Domain-Id: default Aug 26 01:03:02.258049 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Domain-Name: Default Aug 26 01:03:02.258049 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Id: 38047508b7d44f05af7116a15ba7e319 Aug 26 01:03:02.258049 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Name: tempest-AttachVolumeNegativeTest-1692640927-project Aug 26 01:03:02.258049 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Aug 26 01:03:02.258049 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: {"volumeAttachment": {"volumeId": "f6116700-aeb2-4fc5-909a-d95b9b4ea02d"}} Aug 26 01:03:02.258049 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: method: > Aug 26 01:03:02.259085 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: exception: Invalid volume: volume f6116700-aeb2-4fc5-909a-d95b9b4ea02d is already attached to instances: f432be84-f338-4303-86a0-a45611eb0850 Aug 26 01:03:02.259085 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: action_args: {'server_id': '3955819b-d03a-4684-aba7-5d485c66a29e', 'body': {'volumeAttachment': {'volumeId': 'f6116700-aeb2-4fc5-909a-d95b9b4ea02d'}}} Aug 26 01:03:02.259085 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 01:03:02.259085 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:03:02.259085 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 26 01:03:02.259085 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 26 01:03:02.259085 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 26 01:03:02.259085 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 26 01:03:02.259085 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 26 01:03:02.259085 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 26 01:03:02.259085 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 26 01:03:02.259085 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 26 01:03:02.259085 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 26 01:03:02.259085 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 26 01:03:02.259085 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f6116700-aeb2-4fc5-909a-d95b9b4ea02d is already attached to instances: f432be84-f338-4303-86a0-a45611eb0850 Aug 26 01:03:02.259085 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:03:02.259085 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:03:02.259085 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:03:02.259085 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:03:02.260716 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:03:02.260716 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:03:02.260716 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 01:03:02.260716 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 01:03:02.260716 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 01:03:02.260716 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 01:03:02.260716 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 01:03:02.260716 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 01:03:02.260716 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 01:03:02.260716 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 01:03:02.260716 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 01:03:02.260716 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 01:03:02.260716 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 26 01:03:02.260716 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 26 01:03:02.260716 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f6116700-aeb2-4fc5-909a-d95b9b4ea02d is already attached to instances: f432be84-f338-4303-86a0-a45611eb0850 Aug 26 01:03:02.260716 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:03:02.260716 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:03:02.260716 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:03:02.260716 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:03:02.260716 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:03:02.262211 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:03:02.262211 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 01:03:02.262211 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 01:03:02.262211 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f6116700-aeb2-4fc5-909a-d95b9b4ea02d is already attached to instances: f432be84-f338-4303-86a0-a45611eb0850 Aug 26 01:03:02.262211 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:03:02.262211 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-511d8c48-fe26-4c38-9ce2-a5183ed91707 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Returning 400 to user: Invalid volume: volume f6116700-aeb2-4fc5-909a-d95b9b4ea02d is already attached to instances: f432be84-f338-4303-86a0-a45611eb0850 {{(pid=127565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 01:03:02.262211 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-511d8c48-fe26-4c38-9ce2-a5183ed91707 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "POST /compute/v2.1/servers/3955819b-d03a-4684-aba7-5d485c66a29e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099644 Aug 26 01:03:02.262211 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 469/942] 10.222.0.59 () {60 vars in 1323 bytes} [Fri Aug 26 01:03:02 2022] POST /compute/v2.1/servers/3955819b-d03a-4684-aba7-5d485c66a29e/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 26 01:03:02.266397 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-da4a4237-1ec1-4a15-b892-4716ae3141b4 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:03:02.267012 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-da4a4237-1ec1-4a15-b892-4716ae3141b4 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: 3955819b-d03a-4684-aba7-5d485c66a29e] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:03:02.273782 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-da4a4237-1ec1-4a15-b892-4716ae3141b4 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:02.274260 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-da4a4237-1ec1-4a15-b892-4716ae3141b4 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:02.274690 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-da4a4237-1ec1-4a15-b892-4716ae3141b4 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:02.275377 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-da4a4237-1ec1-4a15-b892-4716ae3141b4 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:02.275828 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-da4a4237-1ec1-4a15-b892-4716ae3141b4 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:02.276251 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-da4a4237-1ec1-4a15-b892-4716ae3141b4 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:02.300979 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-da4a4237-1ec1-4a15-b892-4716ae3141b4 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: 3955819b-d03a-4684-aba7-5d485c66a29e] Going to try to terminate instance {{(pid=127564) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 01:03:02.576799 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-da4a4237-1ec1-4a15-b892-4716ae3141b4 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "DELETE /compute/v2.1/servers/3955819b-d03a-4684-aba7-5d485c66a29e" status: 204 len: 0 microversion: 2.1 time: 0.313955 Aug 26 01:03:02.577413 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 474/943] 10.222.0.59 () {58 vars in 1239 bytes} [Fri Aug 26 01:03:02 2022] DELETE /compute/v2.1/servers/3955819b-d03a-4684-aba7-5d485c66a29e => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 26 01:03:02.585611 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-8028d0e5-50ae-4193-90a5-0d3f3ead76c8 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:03:02.586209 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-8028d0e5-50ae-4193-90a5-0d3f3ead76c8 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: 3955819b-d03a-4684-aba7-5d485c66a29e] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:03:02.592607 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8028d0e5-50ae-4193-90a5-0d3f3ead76c8 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:02.593081 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8028d0e5-50ae-4193-90a5-0d3f3ead76c8 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:02.593508 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8028d0e5-50ae-4193-90a5-0d3f3ead76c8 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:02.594187 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8028d0e5-50ae-4193-90a5-0d3f3ead76c8 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:02.594629 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8028d0e5-50ae-4193-90a5-0d3f3ead76c8 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:02.595046 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8028d0e5-50ae-4193-90a5-0d3f3ead76c8 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:02.730037 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-8028d0e5-50ae-4193-90a5-0d3f3ead76c8 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38047508b7d44f05af7116a15ba7e319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b021c415a147e08dbfede2ddc8cc27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:03:02.737768 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-8028d0e5-50ae-4193-90a5-0d3f3ead76c8 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/3955819b-d03a-4684-aba7-5d485c66a29e" status: 200 len: 1680 microversion: 2.1 time: 0.156072 Aug 26 01:03:02.738328 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 470/944] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:03:02 2022] GET /compute/v2.1/servers/3955819b-d03a-4684-aba7-5d485c66a29e => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:03:03.759843 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-2348df14-84de-4a58-93c6-2e834aa7287c tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:03:03.760509 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-2348df14-84de-4a58-93c6-2e834aa7287c tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: 3955819b-d03a-4684-aba7-5d485c66a29e] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:03:03.767035 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2348df14-84de-4a58-93c6-2e834aa7287c tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:03.767514 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2348df14-84de-4a58-93c6-2e834aa7287c tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:03.767975 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2348df14-84de-4a58-93c6-2e834aa7287c tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:03.768699 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2348df14-84de-4a58-93c6-2e834aa7287c tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:03.769153 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2348df14-84de-4a58-93c6-2e834aa7287c tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:03.769576 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-2348df14-84de-4a58-93c6-2e834aa7287c tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:03.897037 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-2348df14-84de-4a58-93c6-2e834aa7287c tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38047508b7d44f05af7116a15ba7e319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b021c415a147e08dbfede2ddc8cc27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:03:03.905238 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-2348df14-84de-4a58-93c6-2e834aa7287c tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/3955819b-d03a-4684-aba7-5d485c66a29e" status: 200 len: 1680 microversion: 2.1 time: 0.149667 Aug 26 01:03:03.905803 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 475/945] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:03:03 2022] GET /compute/v2.1/servers/3955819b-d03a-4684-aba7-5d485c66a29e => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:03:04.926677 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-c74d67eb-1117-4218-9235-949e62850a76 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:03:04.927488 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-c74d67eb-1117-4218-9235-949e62850a76 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: 3955819b-d03a-4684-aba7-5d485c66a29e] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:03:04.933882 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c74d67eb-1117-4218-9235-949e62850a76 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:04.934925 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c74d67eb-1117-4218-9235-949e62850a76 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:04.935364 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c74d67eb-1117-4218-9235-949e62850a76 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:04.936038 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c74d67eb-1117-4218-9235-949e62850a76 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:04.936500 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c74d67eb-1117-4218-9235-949e62850a76 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:04.936919 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c74d67eb-1117-4218-9235-949e62850a76 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:05.073203 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-c74d67eb-1117-4218-9235-949e62850a76 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38047508b7d44f05af7116a15ba7e319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b021c415a147e08dbfede2ddc8cc27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:03:05.080861 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-c74d67eb-1117-4218-9235-949e62850a76 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/3955819b-d03a-4684-aba7-5d485c66a29e" status: 200 len: 1680 microversion: 2.1 time: 0.158015 Aug 26 01:03:05.081430 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 471/946] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:03:04 2022] GET /compute/v2.1/servers/3955819b-d03a-4684-aba7-5d485c66a29e => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:03:05.653735 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [req-741e5a60-9cb4-4c58-a4d4-c328ac5ec494 req-b380b579-af0a-4dae-88b6-e52d20cc865f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3955819b-d03a-4684-aba7-5d485c66a29e", "name": "network-vif-deleted", "tag": "66599df3-70a8-4a2f-b18a-a34433739290"}]} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:03:05.663697 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-741e5a60-9cb4-4c58-a4d4-c328ac5ec494 req-b380b579-af0a-4dae-88b6-e52d20cc865f service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:05.664182 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-741e5a60-9cb4-4c58-a4d4-c328ac5ec494 req-b380b579-af0a-4dae-88b6-e52d20cc865f service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:05.664659 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-741e5a60-9cb4-4c58-a4d4-c328ac5ec494 req-b380b579-af0a-4dae-88b6-e52d20cc865f service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:05.676972 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.compute.server_external_events [req-741e5a60-9cb4-4c58-a4d4-c328ac5ec494 req-b380b579-af0a-4dae-88b6-e52d20cc865f service nova] Creating event network-vif-deleted:66599df3-70a8-4a2f-b18a-a34433739290 for instance 3955819b-d03a-4684-aba7-5d485c66a29e on hv-cinder-83538 Aug 26 01:03:05.682314 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [req-741e5a60-9cb4-4c58-a4d4-c328ac5ec494 req-b380b579-af0a-4dae-88b6-e52d20cc865f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032713 Aug 26 01:03:05.683179 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 476/947] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 01:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:03:06.102625 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-1451649a-4cea-48ea-b374-e5e17c0d32c1 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:03:06.103213 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-1451649a-4cea-48ea-b374-e5e17c0d32c1 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: 3955819b-d03a-4684-aba7-5d485c66a29e] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:03:06.109731 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1451649a-4cea-48ea-b374-e5e17c0d32c1 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:06.110216 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1451649a-4cea-48ea-b374-e5e17c0d32c1 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:06.110653 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1451649a-4cea-48ea-b374-e5e17c0d32c1 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:06.111544 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1451649a-4cea-48ea-b374-e5e17c0d32c1 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:06.112000 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1451649a-4cea-48ea-b374-e5e17c0d32c1 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:06.112431 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1451649a-4cea-48ea-b374-e5e17c0d32c1 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:06.145380 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1451649a-4cea-48ea-b374-e5e17c0d32c1 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:06.145866 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1451649a-4cea-48ea-b374-e5e17c0d32c1 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:06.146608 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1451649a-4cea-48ea-b374-e5e17c0d32c1 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:06.147070 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.objects.instance [None req-1451649a-4cea-48ea-b374-e5e17c0d32c1 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lazy-loading 'fault' on Instance uuid 3955819b-d03a-4684-aba7-5d485c66a29e {{(pid=127565) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 01:03:06.192277 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-1451649a-4cea-48ea-b374-e5e17c0d32c1 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38047508b7d44f05af7116a15ba7e319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b021c415a147e08dbfede2ddc8cc27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:03:06.201316 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-1451649a-4cea-48ea-b374-e5e17c0d32c1 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/3955819b-d03a-4684-aba7-5d485c66a29e" status: 200 len: 1330 microversion: 2.1 time: 0.102570 Aug 26 01:03:06.201895 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 472/948] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:03:06 2022] GET /compute/v2.1/servers/3955819b-d03a-4684-aba7-5d485c66a29e => generated 1330 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:03:07.223649 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-3598a3c9-2f4f-46bf-9bdb-310df06d25c3 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:03:07.224370 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-3598a3c9-2f4f-46bf-9bdb-310df06d25c3 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: 3955819b-d03a-4684-aba7-5d485c66a29e] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:03:07.230580 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3598a3c9-2f4f-46bf-9bdb-310df06d25c3 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:07.231546 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3598a3c9-2f4f-46bf-9bdb-310df06d25c3 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:07.231973 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3598a3c9-2f4f-46bf-9bdb-310df06d25c3 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:07.232691 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3598a3c9-2f4f-46bf-9bdb-310df06d25c3 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:07.233140 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3598a3c9-2f4f-46bf-9bdb-310df06d25c3 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:07.233562 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3598a3c9-2f4f-46bf-9bdb-310df06d25c3 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:07.246440 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.wsgi [None req-3598a3c9-2f4f-46bf-9bdb-310df06d25c3 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] HTTP exception thrown: Instance 3955819b-d03a-4684-aba7-5d485c66a29e could not be found. Aug 26 01:03:07.248618 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-3598a3c9-2f4f-46bf-9bdb-310df06d25c3 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Request method failure captured: Aug 26 01:03:07.248618 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: request: GET /compute/v2.1/servers/3955819b-d03a-4684-aba7-5d485c66a29e HTTP/1.1 Aug 26 01:03:07.248618 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Accept: application/json Aug 26 01:03:07.248618 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Accept-Encoding: identity Aug 26 01:03:07.248618 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Connection: close Aug 26 01:03:07.248618 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Content-Length: 0 Aug 26 01:03:07.248618 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Content-Type: application/json Aug 26 01:03:07.248618 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Host: 10.222.0.59 Aug 26 01:03:07.248618 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Openstack-System-Scope: None Aug 26 01:03:07.248618 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: User-Agent: python-urllib3/1.26.11 Aug 26 01:03:07.248618 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Auth-Token: gAAAAABjCBtKv7Ptmn6ODyXcqDwiO_uQzh6mqyqflGy1xdbBhbXPxieO4RSPPFbB4mQUaGf6pIM59uQGaWkpT_lu6RdlUkkLPi08g2IwRrKssv3K5sM8xJTV55LE3mg5hFUUhkTXeZla8aTh4ipX4VYHFhrTqhydw3qJT6H_hFgb5jrawb0wsSk Aug 26 01:03:07.248618 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Domain-Id: None Aug 26 01:03:07.248618 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Domain-Name: None Aug 26 01:03:07.248618 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Identity-Status: Confirmed Aug 26 01:03:07.248618 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Is-Admin-Project: True Aug 26 01:03:07.248618 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Domain-Id: default Aug 26 01:03:07.248618 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Domain-Name: Default Aug 26 01:03:07.248618 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Id: 03b021c415a147e08dbfede2ddc8cc27 Aug 26 01:03:07.248618 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Name: tempest-AttachVolumeNegativeTest-1692640927 Aug 26 01:03:07.248618 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Role: reader,member Aug 26 01:03:07.248618 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Roles: reader,member Aug 26 01:03:07.250301 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_03b021c415a147e08dbfede2ddc8cc27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/03b021c415a147e08dbfede2ddc8cc27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/03b021c415a147e08dbfede2ddc8cc27"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/03b021c415a147e08dbfede2ddc8cc27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 01:03:07.250301 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant: tempest-AttachVolumeNegativeTest-1692640927 Aug 26 01:03:07.250301 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant-Id: 03b021c415a147e08dbfede2ddc8cc27 Aug 26 01:03:07.250301 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1692640927 Aug 26 01:03:07.250301 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User: tempest-AttachVolumeNegativeTest-1692640927-project Aug 26 01:03:07.250301 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Domain-Id: default Aug 26 01:03:07.250301 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Domain-Name: Default Aug 26 01:03:07.250301 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Id: 38047508b7d44f05af7116a15ba7e319 Aug 26 01:03:07.250301 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Name: tempest-AttachVolumeNegativeTest-1692640927-project Aug 26 01:03:07.250301 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: method: > Aug 26 01:03:07.250301 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: exception: Instance 3955819b-d03a-4684-aba7-5d485c66a29e could not be found. Aug 26 01:03:07.250301 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: action_args: {'id': '3955819b-d03a-4684-aba7-5d485c66a29e'} Aug 26 01:03:07.251250 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 01:03:07.251250 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:03:07.251250 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 01:03:07.251250 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 01:03:07.251250 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 01:03:07.251250 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 01:03:07.251250 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 01:03:07.251250 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 01:03:07.251250 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 01:03:07.251250 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 01:03:07.251250 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3955819b-d03a-4684-aba7-5d485c66a29e could not be found. Aug 26 01:03:07.251250 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:03:07.251250 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:03:07.251250 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:03:07.251250 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:03:07.251250 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:03:07.251250 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:03:07.251250 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 01:03:07.251250 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 01:03:07.251250 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 01:03:07.252850 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 01:03:07.252850 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 01:03:07.252850 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 01:03:07.252850 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 01:03:07.252850 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 01:03:07.252850 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 01:03:07.252850 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 01:03:07.252850 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3955819b-d03a-4684-aba7-5d485c66a29e could not be found. Aug 26 01:03:07.252850 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:03:07.252850 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:03:07.252850 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:03:07.252850 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:03:07.252850 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:03:07.252850 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:03:07.252850 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 01:03:07.252850 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 01:03:07.252850 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3955819b-d03a-4684-aba7-5d485c66a29e could not be found. Aug 26 01:03:07.252850 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:03:07.254384 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-3598a3c9-2f4f-46bf-9bdb-310df06d25c3 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Returning 404 to user: Instance 3955819b-d03a-4684-aba7-5d485c66a29e could not be found. {{(pid=127564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 01:03:07.254384 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-3598a3c9-2f4f-46bf-9bdb-310df06d25c3 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/3955819b-d03a-4684-aba7-5d485c66a29e" status: 404 len: 111 microversion: 2.1 time: 0.031311 Aug 26 01:03:07.254384 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 477/949] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:03:07 2022] GET /compute/v2.1/servers/3955819b-d03a-4684-aba7-5d485c66a29e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 01:03:07.258704 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-ee4db872-5737-4e31-84e3-6dbe2710a1f0 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '.version_select at 0x7f8a92dd9ee0>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:03:07.353755 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-ee4db872-5737-4e31-84e3-6dbe2710a1f0 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-346910097" status: 202 len: 0 microversion: 2.1 time: 0.098794 Aug 26 01:03:07.354321 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 473/950] 10.222.0.59 () {58 vars in 1218 bytes} [Fri Aug 26 01:03:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-346910097 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 01:03:08.274032 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-d58964e3-b9c7-4ab8-a59b-8195cda500ca tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:03:08.274521 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-d58964e3-b9c7-4ab8-a59b-8195cda500ca tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: f432be84-f338-4303-86a0-a45611eb0850] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:03:08.281085 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-d58964e3-b9c7-4ab8-a59b-8195cda500ca tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:08.281566 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-d58964e3-b9c7-4ab8-a59b-8195cda500ca tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:08.282002 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-d58964e3-b9c7-4ab8-a59b-8195cda500ca tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:08.282826 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-d58964e3-b9c7-4ab8-a59b-8195cda500ca tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:08.283293 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-d58964e3-b9c7-4ab8-a59b-8195cda500ca tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:08.283721 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-d58964e3-b9c7-4ab8-a59b-8195cda500ca tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:08.362595 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.objects.instance [None req-d58964e3-b9c7-4ab8-a59b-8195cda500ca tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lazy-loading 'services' on Instance uuid f432be84-f338-4303-86a0-a45611eb0850 {{(pid=127564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 01:03:08.586024 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-d58964e3-b9c7-4ab8-a59b-8195cda500ca tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "DELETE /compute/v2.1/servers/f432be84-f338-4303-86a0-a45611eb0850/os-volume_attachments/f6116700-aeb2-4fc5-909a-d95b9b4ea02d" status: 202 len: 0 microversion: 2.1 time: 0.315742 Aug 26 01:03:08.586595 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 478/951] 10.222.0.59 () {58 vars in 1416 bytes} [Fri Aug 26 01:03:08 2022] DELETE /compute/v2.1/servers/f432be84-f338-4303-86a0-a45611eb0850/os-volume_attachments/f6116700-aeb2-4fc5-909a-d95b9b4ea02d => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 01:03:08.596809 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-20f8d537-8636-40b6-a379-1c6c982ce120 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:03:08.598959 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-20f8d537-8636-40b6-a379-1c6c982ce120 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: f432be84-f338-4303-86a0-a45611eb0850] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:03:08.605923 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-20f8d537-8636-40b6-a379-1c6c982ce120 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:08.606414 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-20f8d537-8636-40b6-a379-1c6c982ce120 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:08.606855 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-20f8d537-8636-40b6-a379-1c6c982ce120 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:08.607549 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-20f8d537-8636-40b6-a379-1c6c982ce120 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:08.608027 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-20f8d537-8636-40b6-a379-1c6c982ce120 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:08.608454 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-20f8d537-8636-40b6-a379-1c6c982ce120 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:08.638245 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-20f8d537-8636-40b6-a379-1c6c982ce120 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/f432be84-f338-4303-86a0-a45611eb0850/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046607 Aug 26 01:03:08.642803 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 474/952] 10.222.0.59 () {58 vars in 1302 bytes} [Fri Aug 26 01:03:08 2022] GET /compute/v2.1/servers/f432be84-f338-4303-86a0-a45611eb0850/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:03:09.651673 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-8c5dba77-ffd7-4233-9dad-ee72ba1da5b5 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:03:09.654538 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-8c5dba77-ffd7-4233-9dad-ee72ba1da5b5 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: f432be84-f338-4303-86a0-a45611eb0850] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:03:09.660837 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8c5dba77-ffd7-4233-9dad-ee72ba1da5b5 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:09.661336 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8c5dba77-ffd7-4233-9dad-ee72ba1da5b5 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:09.661758 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8c5dba77-ffd7-4233-9dad-ee72ba1da5b5 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:09.662706 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8c5dba77-ffd7-4233-9dad-ee72ba1da5b5 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:09.663160 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8c5dba77-ffd7-4233-9dad-ee72ba1da5b5 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:09.663580 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8c5dba77-ffd7-4233-9dad-ee72ba1da5b5 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:09.693758 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-8c5dba77-ffd7-4233-9dad-ee72ba1da5b5 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/f432be84-f338-4303-86a0-a45611eb0850/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046907 Aug 26 01:03:09.694230 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 479/953] 10.222.0.59 () {58 vars in 1302 bytes} [Fri Aug 26 01:03:09 2022] GET /compute/v2.1/servers/f432be84-f338-4303-86a0-a45611eb0850/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:03:10.707347 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-afbcd80a-a864-4ce7-9ec0-c5d63e67bc0b tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:03:10.709749 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-afbcd80a-a864-4ce7-9ec0-c5d63e67bc0b tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: f432be84-f338-4303-86a0-a45611eb0850] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:03:10.716794 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-afbcd80a-a864-4ce7-9ec0-c5d63e67bc0b tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:10.717271 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-afbcd80a-a864-4ce7-9ec0-c5d63e67bc0b tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:10.717712 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-afbcd80a-a864-4ce7-9ec0-c5d63e67bc0b tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:10.718397 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-afbcd80a-a864-4ce7-9ec0-c5d63e67bc0b tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:10.718848 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-afbcd80a-a864-4ce7-9ec0-c5d63e67bc0b tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:10.719267 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-afbcd80a-a864-4ce7-9ec0-c5d63e67bc0b tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:10.747457 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-afbcd80a-a864-4ce7-9ec0-c5d63e67bc0b tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/f432be84-f338-4303-86a0-a45611eb0850/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044856 Aug 26 01:03:10.748005 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 475/954] 10.222.0.59 () {58 vars in 1302 bytes} [Fri Aug 26 01:03:10 2022] GET /compute/v2.1/servers/f432be84-f338-4303-86a0-a45611eb0850/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 01:03:10.807881 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-84c3f5f5-16c8-40b2-811a-d5e2d81ec373 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:03:10.808415 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-84c3f5f5-16c8-40b2-811a-d5e2d81ec373 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: f432be84-f338-4303-86a0-a45611eb0850] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:03:10.815839 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-84c3f5f5-16c8-40b2-811a-d5e2d81ec373 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:10.816580 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-84c3f5f5-16c8-40b2-811a-d5e2d81ec373 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:10.817235 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-84c3f5f5-16c8-40b2-811a-d5e2d81ec373 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:10.818263 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-84c3f5f5-16c8-40b2-811a-d5e2d81ec373 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:10.818947 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-84c3f5f5-16c8-40b2-811a-d5e2d81ec373 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:10.819601 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-84c3f5f5-16c8-40b2-811a-d5e2d81ec373 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:10.857025 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-84c3f5f5-16c8-40b2-811a-d5e2d81ec373 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: f432be84-f338-4303-86a0-a45611eb0850] Going to try to terminate instance {{(pid=127564) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 01:03:11.290867 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-84c3f5f5-16c8-40b2-811a-d5e2d81ec373 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "DELETE /compute/v2.1/servers/f432be84-f338-4303-86a0-a45611eb0850" status: 204 len: 0 microversion: 2.1 time: 0.486436 Aug 26 01:03:11.291453 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 480/955] 10.222.0.59 () {58 vars in 1239 bytes} [Fri Aug 26 01:03:10 2022] DELETE /compute/v2.1/servers/f432be84-f338-4303-86a0-a45611eb0850 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 01:03:11.299666 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-9d773784-e9d2-4723-89ee-ee9b139fdaa7 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:03:11.304077 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-9d773784-e9d2-4723-89ee-ee9b139fdaa7 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: f432be84-f338-4303-86a0-a45611eb0850] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:03:11.306251 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9d773784-e9d2-4723-89ee-ee9b139fdaa7 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:11.306734 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9d773784-e9d2-4723-89ee-ee9b139fdaa7 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:11.307170 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9d773784-e9d2-4723-89ee-ee9b139fdaa7 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:11.307867 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9d773784-e9d2-4723-89ee-ee9b139fdaa7 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:11.308318 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9d773784-e9d2-4723-89ee-ee9b139fdaa7 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:11.308777 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9d773784-e9d2-4723-89ee-ee9b139fdaa7 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:11.435831 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-9d773784-e9d2-4723-89ee-ee9b139fdaa7 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38047508b7d44f05af7116a15ba7e319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b021c415a147e08dbfede2ddc8cc27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:03:11.443639 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-9d773784-e9d2-4723-89ee-ee9b139fdaa7 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/f432be84-f338-4303-86a0-a45611eb0850" status: 200 len: 1683 microversion: 2.1 time: 0.147779 Aug 26 01:03:11.444203 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 476/956] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:03:11 2022] GET /compute/v2.1/servers/f432be84-f338-4303-86a0-a45611eb0850 => generated 1683 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:03:12.464592 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-db0a0124-41ef-458d-9ac6-09d35bb7f762 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:03:12.465321 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-db0a0124-41ef-458d-9ac6-09d35bb7f762 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: f432be84-f338-4303-86a0-a45611eb0850] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:03:12.471907 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-db0a0124-41ef-458d-9ac6-09d35bb7f762 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:12.472387 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-db0a0124-41ef-458d-9ac6-09d35bb7f762 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:12.472886 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-db0a0124-41ef-458d-9ac6-09d35bb7f762 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:12.473575 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-db0a0124-41ef-458d-9ac6-09d35bb7f762 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:12.474028 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-db0a0124-41ef-458d-9ac6-09d35bb7f762 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:12.474455 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-db0a0124-41ef-458d-9ac6-09d35bb7f762 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:12.618524 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-db0a0124-41ef-458d-9ac6-09d35bb7f762 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38047508b7d44f05af7116a15ba7e319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b021c415a147e08dbfede2ddc8cc27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:03:12.626357 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-db0a0124-41ef-458d-9ac6-09d35bb7f762 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/f432be84-f338-4303-86a0-a45611eb0850" status: 200 len: 1683 microversion: 2.1 time: 0.165951 Aug 26 01:03:12.626923 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 481/957] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:03:12 2022] GET /compute/v2.1/servers/f432be84-f338-4303-86a0-a45611eb0850 => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:03:13.647179 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-07c86a77-b2cb-4026-ba61-18477e017943 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:03:13.647793 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-07c86a77-b2cb-4026-ba61-18477e017943 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: f432be84-f338-4303-86a0-a45611eb0850] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:03:13.657861 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-07c86a77-b2cb-4026-ba61-18477e017943 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:13.658385 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-07c86a77-b2cb-4026-ba61-18477e017943 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:13.658823 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-07c86a77-b2cb-4026-ba61-18477e017943 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:13.659513 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-07c86a77-b2cb-4026-ba61-18477e017943 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:13.659992 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-07c86a77-b2cb-4026-ba61-18477e017943 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:13.660413 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-07c86a77-b2cb-4026-ba61-18477e017943 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:13.796013 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-07c86a77-b2cb-4026-ba61-18477e017943 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38047508b7d44f05af7116a15ba7e319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b021c415a147e08dbfede2ddc8cc27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:03:13.803724 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-07c86a77-b2cb-4026-ba61-18477e017943 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/f432be84-f338-4303-86a0-a45611eb0850" status: 200 len: 1683 microversion: 2.1 time: 0.160424 Aug 26 01:03:13.804453 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 477/958] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:03:13 2022] GET /compute/v2.1/servers/f432be84-f338-4303-86a0-a45611eb0850 => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:03:14.095053 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [req-f7167103-e462-403f-84c1-abf5ecc8a27c req-2204dd75-d606-4e1c-86ec-2bf781d14556 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f432be84-f338-4303-86a0-a45611eb0850", "name": "network-vif-deleted", "tag": "312556d9-9bb5-4bfb-b174-e5a4f1da74ce"}]} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:03:14.104724 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-f7167103-e462-403f-84c1-abf5ecc8a27c req-2204dd75-d606-4e1c-86ec-2bf781d14556 service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:14.108822 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-f7167103-e462-403f-84c1-abf5ecc8a27c req-2204dd75-d606-4e1c-86ec-2bf781d14556 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:14.108822 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-f7167103-e462-403f-84c1-abf5ecc8a27c req-2204dd75-d606-4e1c-86ec-2bf781d14556 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:14.118140 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.compute.server_external_events [req-f7167103-e462-403f-84c1-abf5ecc8a27c req-2204dd75-d606-4e1c-86ec-2bf781d14556 service nova] Creating event network-vif-deleted:312556d9-9bb5-4bfb-b174-e5a4f1da74ce for instance f432be84-f338-4303-86a0-a45611eb0850 on hv-cinder-83538 Aug 26 01:03:14.123305 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [req-f7167103-e462-403f-84c1-abf5ecc8a27c req-2204dd75-d606-4e1c-86ec-2bf781d14556 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034045 Aug 26 01:03:14.123988 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 482/959] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 01:03:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:03:14.826180 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-7815a8be-3f7d-48e9-b6ca-20c437814b5c tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:03:14.829360 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-7815a8be-3f7d-48e9-b6ca-20c437814b5c tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: f432be84-f338-4303-86a0-a45611eb0850] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:03:14.833627 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7815a8be-3f7d-48e9-b6ca-20c437814b5c tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:14.834116 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7815a8be-3f7d-48e9-b6ca-20c437814b5c tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:14.834551 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7815a8be-3f7d-48e9-b6ca-20c437814b5c tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:14.835245 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7815a8be-3f7d-48e9-b6ca-20c437814b5c tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:14.835697 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7815a8be-3f7d-48e9-b6ca-20c437814b5c tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:14.836119 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7815a8be-3f7d-48e9-b6ca-20c437814b5c tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:14.870643 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7815a8be-3f7d-48e9-b6ca-20c437814b5c tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:14.871665 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7815a8be-3f7d-48e9-b6ca-20c437814b5c tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:14.872102 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7815a8be-3f7d-48e9-b6ca-20c437814b5c tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:14.872581 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.objects.instance [None req-7815a8be-3f7d-48e9-b6ca-20c437814b5c tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lazy-loading 'fault' on Instance uuid f432be84-f338-4303-86a0-a45611eb0850 {{(pid=127565) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 01:03:14.916390 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-7815a8be-3f7d-48e9-b6ca-20c437814b5c tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38047508b7d44f05af7116a15ba7e319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b021c415a147e08dbfede2ddc8cc27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:03:14.924359 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-7815a8be-3f7d-48e9-b6ca-20c437814b5c tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/f432be84-f338-4303-86a0-a45611eb0850" status: 200 len: 1332 microversion: 2.1 time: 0.102590 Aug 26 01:03:14.924960 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 478/960] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:03:14 2022] GET /compute/v2.1/servers/f432be84-f338-4303-86a0-a45611eb0850 => generated 1332 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:03:15.946472 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-1f47959d-e2e6-44e8-88fa-10a931e06f6d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:03:15.947161 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-1f47959d-e2e6-44e8-88fa-10a931e06f6d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: f432be84-f338-4303-86a0-a45611eb0850] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:03:15.954319 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1f47959d-e2e6-44e8-88fa-10a931e06f6d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:15.954790 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1f47959d-e2e6-44e8-88fa-10a931e06f6d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:15.955217 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1f47959d-e2e6-44e8-88fa-10a931e06f6d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:15.955890 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1f47959d-e2e6-44e8-88fa-10a931e06f6d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:15.956333 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1f47959d-e2e6-44e8-88fa-10a931e06f6d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:15.956779 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1f47959d-e2e6-44e8-88fa-10a931e06f6d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:15.970344 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.wsgi [None req-1f47959d-e2e6-44e8-88fa-10a931e06f6d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] HTTP exception thrown: Instance f432be84-f338-4303-86a0-a45611eb0850 could not be found. Aug 26 01:03:15.971930 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-1f47959d-e2e6-44e8-88fa-10a931e06f6d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Request method failure captured: Aug 26 01:03:15.971930 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: request: GET /compute/v2.1/servers/f432be84-f338-4303-86a0-a45611eb0850 HTTP/1.1 Aug 26 01:03:15.971930 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Accept: application/json Aug 26 01:03:15.971930 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Accept-Encoding: identity Aug 26 01:03:15.971930 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Connection: close Aug 26 01:03:15.971930 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Content-Length: 0 Aug 26 01:03:15.971930 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Content-Type: application/json Aug 26 01:03:15.971930 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Host: 10.222.0.59 Aug 26 01:03:15.971930 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Openstack-System-Scope: None Aug 26 01:03:15.971930 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: User-Agent: python-urllib3/1.26.11 Aug 26 01:03:15.971930 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Auth-Token: gAAAAABjCBtKv7Ptmn6ODyXcqDwiO_uQzh6mqyqflGy1xdbBhbXPxieO4RSPPFbB4mQUaGf6pIM59uQGaWkpT_lu6RdlUkkLPi08g2IwRrKssv3K5sM8xJTV55LE3mg5hFUUhkTXeZla8aTh4ipX4VYHFhrTqhydw3qJT6H_hFgb5jrawb0wsSk Aug 26 01:03:15.971930 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Domain-Id: None Aug 26 01:03:15.971930 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Domain-Name: None Aug 26 01:03:15.971930 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Identity-Status: Confirmed Aug 26 01:03:15.971930 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Is-Admin-Project: True Aug 26 01:03:15.971930 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Domain-Id: default Aug 26 01:03:15.971930 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Domain-Name: Default Aug 26 01:03:15.971930 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Id: 03b021c415a147e08dbfede2ddc8cc27 Aug 26 01:03:15.971930 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Name: tempest-AttachVolumeNegativeTest-1692640927 Aug 26 01:03:15.971930 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Role: reader,member Aug 26 01:03:15.971930 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Roles: reader,member Aug 26 01:03:15.973674 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_03b021c415a147e08dbfede2ddc8cc27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/03b021c415a147e08dbfede2ddc8cc27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/03b021c415a147e08dbfede2ddc8cc27"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/03b021c415a147e08dbfede2ddc8cc27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 01:03:15.973674 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant: tempest-AttachVolumeNegativeTest-1692640927 Aug 26 01:03:15.973674 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant-Id: 03b021c415a147e08dbfede2ddc8cc27 Aug 26 01:03:15.973674 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1692640927 Aug 26 01:03:15.973674 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User: tempest-AttachVolumeNegativeTest-1692640927-project Aug 26 01:03:15.973674 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Domain-Id: default Aug 26 01:03:15.973674 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Domain-Name: Default Aug 26 01:03:15.973674 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Id: 38047508b7d44f05af7116a15ba7e319 Aug 26 01:03:15.973674 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Name: tempest-AttachVolumeNegativeTest-1692640927-project Aug 26 01:03:15.973674 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: method: > Aug 26 01:03:15.973674 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: exception: Instance f432be84-f338-4303-86a0-a45611eb0850 could not be found. Aug 26 01:03:15.973674 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: action_args: {'id': 'f432be84-f338-4303-86a0-a45611eb0850'} Aug 26 01:03:15.974645 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 01:03:15.974645 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:03:15.974645 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 01:03:15.974645 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 01:03:15.974645 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 01:03:15.974645 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 01:03:15.974645 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 01:03:15.974645 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 01:03:15.974645 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 01:03:15.974645 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 01:03:15.974645 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f432be84-f338-4303-86a0-a45611eb0850 could not be found. Aug 26 01:03:15.974645 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:03:15.974645 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:03:15.974645 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:03:15.974645 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:03:15.974645 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:03:15.974645 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:03:15.974645 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 01:03:15.974645 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 01:03:15.974645 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 01:03:15.976225 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 01:03:15.976225 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 01:03:15.976225 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 01:03:15.976225 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 01:03:15.976225 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 01:03:15.976225 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 01:03:15.976225 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 01:03:15.976225 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f432be84-f338-4303-86a0-a45611eb0850 could not be found. Aug 26 01:03:15.976225 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:03:15.976225 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:03:15.976225 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:03:15.976225 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:03:15.976225 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:03:15.976225 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:03:15.976225 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 01:03:15.976225 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 01:03:15.976225 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f432be84-f338-4303-86a0-a45611eb0850 could not be found. Aug 26 01:03:15.976225 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:03:15.977624 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-1f47959d-e2e6-44e8-88fa-10a931e06f6d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Returning 404 to user: Instance f432be84-f338-4303-86a0-a45611eb0850 could not be found. {{(pid=127564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 01:03:15.977624 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-1f47959d-e2e6-44e8-88fa-10a931e06f6d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/f432be84-f338-4303-86a0-a45611eb0850" status: 404 len: 111 microversion: 2.1 time: 0.031068 Aug 26 01:03:15.977624 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 483/961] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:03:15 2022] GET /compute/v2.1/servers/f432be84-f338-4303-86a0-a45611eb0850 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 01:03:15.982040 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-25f0535a-422d-4dae-9c1e-58ae92932126 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '.version_select at 0x7f8a92d56820>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:03:16.057572 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-25f0535a-422d-4dae-9c1e-58ae92932126 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1253791505" status: 202 len: 0 microversion: 2.1 time: 0.079156 Aug 26 01:03:16.058313 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 479/962] 10.222.0.59 () {58 vars in 1221 bytes} [Fri Aug 26 01:03:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1253791505 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 26 01:03:16.881950 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-c0d95857-54c8-4736-9c62-9b885a714fe0 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Action: 'create', calling method: .version_select at 0x7f8a9666f280>, body: {"keypair": {"name": "tempest-keypair-1648508237", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGPNxYB7EpwQIIqJftW2yiXZoSJGtREUzpW/aiTckkxy2E6KK1AY3opfZZsMq81BRmKp/GQpvjw95y0I5Xw0QhVZ90y3r/WomU18iSBxzSQiA562YPZWYQwRhZ2wdpphSw=="}} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:03:16.897624 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.quota [None req-c0d95857-54c8-4736-9c62-9b885a714fe0 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Getting quotas for project 03b021c415a147e08dbfede2ddc8cc27. Resources: {'key_pairs'} {{(pid=127564) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 01:03:16.901426 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.quota [None req-c0d95857-54c8-4736-9c62-9b885a714fe0 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Getting quotas for user 38047508b7d44f05af7116a15ba7e319 and project 03b021c415a147e08dbfede2ddc8cc27. Resources: {'key_pairs'} {{(pid=127564) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 01:03:16.983309 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-c0d95857-54c8-4736-9c62-9b885a714fe0 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.105169 Aug 26 01:03:16.983979 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 484/963] 10.222.0.59 () {60 vars in 1159 bytes} [Fri Aug 26 01:03:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:03:19.291610 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-cf4ea14d-017d-4903-a2f4-69110bd724a0 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1962817801", "imageRef": "ef60327f-6e0c-4f85-8db9-6f6e8968fe9c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "de5adc9b-87c3-4a41-9cca-c473a399648a"}], "security_groups": [{"name": "tempest-securitygroup--2097570769"}], "key_name": "tempest-keypair-1648508237", "user_data": "}} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:03:19.627762 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.network.neutron [None req-cf4ea14d-017d-4903-a2f4-69110bd724a0 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] validate_networks() for [('de5adc9b-87c3-4a41-9cca-c473a399648a', None, None, None, None, None)] {{(pid=127565) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 01:03:19.990274 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.virt.hardware [None req-cf4ea14d-017d-4903-a2f4-69110bd724a0 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Flavor limits 0:0:0 {{(pid=127565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 01:03:19.990763 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.virt.hardware [None req-cf4ea14d-017d-4903-a2f4-69110bd724a0 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Image limits 0:0:0 {{(pid=127565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 01:03:19.991262 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.virt.hardware [None req-cf4ea14d-017d-4903-a2f4-69110bd724a0 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Flavor pref 0:0:0 {{(pid=127565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 01:03:19.991668 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.virt.hardware [None req-cf4ea14d-017d-4903-a2f4-69110bd724a0 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Image pref 0:0:0 {{(pid=127565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 01:03:19.992104 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.virt.hardware [None req-cf4ea14d-017d-4903-a2f4-69110bd724a0 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 01:03:20.001163 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-cf4ea14d-017d-4903-a2f4-69110bd724a0 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:20.001641 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-cf4ea14d-017d-4903-a2f4-69110bd724a0 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:20.002072 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-cf4ea14d-017d-4903-a2f4-69110bd724a0 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:20.002794 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-cf4ea14d-017d-4903-a2f4-69110bd724a0 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:20.003242 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-cf4ea14d-017d-4903-a2f4-69110bd724a0 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:20.003664 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-cf4ea14d-017d-4903-a2f4-69110bd724a0 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:20.021685 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.quota [None req-cf4ea14d-017d-4903-a2f4-69110bd724a0 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Getting quotas for project 03b021c415a147e08dbfede2ddc8cc27. Resources: {'instances', 'ram', 'cores'} {{(pid=127565) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 01:03:20.025676 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.quota [None req-cf4ea14d-017d-4903-a2f4-69110bd724a0 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Getting quotas for user 38047508b7d44f05af7116a15ba7e319 and project 03b021c415a147e08dbfede2ddc8cc27. Resources: {'instances', 'ram', 'cores'} {{(pid=127565) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 01:03:20.037492 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-cf4ea14d-017d-4903-a2f4-69110bd724a0 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Going to run 1 instances... {{(pid=127565) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 01:03:20.039787 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-cf4ea14d-017d-4903-a2f4-69110bd724a0 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: e5344f30-5e79-4f69-a954-d080b6b9f7ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ef60327f-6e0c-4f85-8db9-6f6e8968fe9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127565) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 01:03:20.185747 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-cf4ea14d-017d-4903-a2f4-69110bd724a0 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.898978 Aug 26 01:03:20.186314 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 480/964] 10.222.0.59 () {60 vars in 1147 bytes} [Fri Aug 26 01:03:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 900 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 01:03:20.197864 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-26ceda67-3332-4d11-8898-058b0c3817ea tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:03:20.198499 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-26ceda67-3332-4d11-8898-058b0c3817ea tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: e5344f30-5e79-4f69-a954-d080b6b9f7ed] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:03:20.254448 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-26ceda67-3332-4d11-8898-058b0c3817ea tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38047508b7d44f05af7116a15ba7e319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b021c415a147e08dbfede2ddc8cc27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:03:20.261384 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-26ceda67-3332-4d11-8898-058b0c3817ea tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/e5344f30-5e79-4f69-a954-d080b6b9f7ed" status: 200 len: 1242 microversion: 2.1 time: 0.068068 Aug 26 01:03:20.262713 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 485/965] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:03:20 2022] GET /compute/v2.1/servers/e5344f30-5e79-4f69-a954-d080b6b9f7ed => generated 1242 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:03:21.282130 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-01876f86-6b20-4d94-b2d6-45324477337a tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:03:21.282832 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-01876f86-6b20-4d94-b2d6-45324477337a tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: e5344f30-5e79-4f69-a954-d080b6b9f7ed] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:03:21.290527 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-01876f86-6b20-4d94-b2d6-45324477337a tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:21.291143 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-01876f86-6b20-4d94-b2d6-45324477337a tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:21.291576 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-01876f86-6b20-4d94-b2d6-45324477337a tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:21.292262 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-01876f86-6b20-4d94-b2d6-45324477337a tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:21.292734 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-01876f86-6b20-4d94-b2d6-45324477337a tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:21.293152 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-01876f86-6b20-4d94-b2d6-45324477337a tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:21.355531 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-01876f86-6b20-4d94-b2d6-45324477337a tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38047508b7d44f05af7116a15ba7e319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b021c415a147e08dbfede2ddc8cc27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:03:21.363485 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-01876f86-6b20-4d94-b2d6-45324477337a tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/e5344f30-5e79-4f69-a954-d080b6b9f7ed" status: 200 len: 1246 microversion: 2.1 time: 0.085881 Aug 26 01:03:21.369066 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 481/966] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:03:21 2022] GET /compute/v2.1/servers/e5344f30-5e79-4f69-a954-d080b6b9f7ed => generated 1246 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 01:03:22.384161 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-32bf2997-0724-4375-b025-148c5bb4bd67 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:03:22.384807 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-32bf2997-0724-4375-b025-148c5bb4bd67 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: e5344f30-5e79-4f69-a954-d080b6b9f7ed] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:03:22.391789 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-32bf2997-0724-4375-b025-148c5bb4bd67 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:22.392278 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-32bf2997-0724-4375-b025-148c5bb4bd67 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:22.392808 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-32bf2997-0724-4375-b025-148c5bb4bd67 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:22.393503 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-32bf2997-0724-4375-b025-148c5bb4bd67 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:22.393958 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-32bf2997-0724-4375-b025-148c5bb4bd67 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:22.394385 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-32bf2997-0724-4375-b025-148c5bb4bd67 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:22.473003 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-32bf2997-0724-4375-b025-148c5bb4bd67 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38047508b7d44f05af7116a15ba7e319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b021c415a147e08dbfede2ddc8cc27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:03:22.481783 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-32bf2997-0724-4375-b025-148c5bb4bd67 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/e5344f30-5e79-4f69-a954-d080b6b9f7ed" status: 200 len: 1302 microversion: 2.1 time: 0.101547 Aug 26 01:03:22.482384 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 486/967] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:03:22 2022] GET /compute/v2.1/servers/e5344f30-5e79-4f69-a954-d080b6b9f7ed => generated 1302 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:03:23.501574 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-0c3a9ed8-d583-40ac-ac7a-bae68a50f10d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:03:23.502284 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-0c3a9ed8-d583-40ac-ac7a-bae68a50f10d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: e5344f30-5e79-4f69-a954-d080b6b9f7ed] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:03:23.509676 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0c3a9ed8-d583-40ac-ac7a-bae68a50f10d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:23.510244 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0c3a9ed8-d583-40ac-ac7a-bae68a50f10d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:23.510739 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0c3a9ed8-d583-40ac-ac7a-bae68a50f10d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:23.511435 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0c3a9ed8-d583-40ac-ac7a-bae68a50f10d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:23.512380 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0c3a9ed8-d583-40ac-ac7a-bae68a50f10d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:23.512827 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0c3a9ed8-d583-40ac-ac7a-bae68a50f10d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:23.645524 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-0c3a9ed8-d583-40ac-ac7a-bae68a50f10d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38047508b7d44f05af7116a15ba7e319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b021c415a147e08dbfede2ddc8cc27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:03:23.662267 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-0c3a9ed8-d583-40ac-ac7a-bae68a50f10d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/e5344f30-5e79-4f69-a954-d080b6b9f7ed" status: 200 len: 1368 microversion: 2.1 time: 0.164252 Aug 26 01:03:23.663143 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 482/968] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:03:23 2022] GET /compute/v2.1/servers/e5344f30-5e79-4f69-a954-d080b6b9f7ed => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:03:24.043488 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [req-8de3637f-107e-46c4-910d-772d375a61ea req-433cece9-b6ff-4ff8-b591-d3b863912ba9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5344f30-5e79-4f69-a954-d080b6b9f7ed", "tag": "bd537a03-4210-4576-9d92-e96d9f5b3e29"}]} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:03:24.054282 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-8de3637f-107e-46c4-910d-772d375a61ea req-433cece9-b6ff-4ff8-b591-d3b863912ba9 service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:24.055021 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-8de3637f-107e-46c4-910d-772d375a61ea req-433cece9-b6ff-4ff8-b591-d3b863912ba9 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:24.055451 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-8de3637f-107e-46c4-910d-772d375a61ea req-433cece9-b6ff-4ff8-b591-d3b863912ba9 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:24.068121 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.compute.server_external_events [req-8de3637f-107e-46c4-910d-772d375a61ea req-433cece9-b6ff-4ff8-b591-d3b863912ba9 service nova] Creating event network-changed:bd537a03-4210-4576-9d92-e96d9f5b3e29 for instance e5344f30-5e79-4f69-a954-d080b6b9f7ed on hv-cinder-83538 Aug 26 01:03:24.073061 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [req-8de3637f-107e-46c4-910d-772d375a61ea req-433cece9-b6ff-4ff8-b591-d3b863912ba9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033329 Aug 26 01:03:24.073718 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 487/969] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 01:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:03:24.683228 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-2a9e30ce-4b07-42f3-9023-76b33951180b tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:03:24.684463 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-2a9e30ce-4b07-42f3-9023-76b33951180b tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: e5344f30-5e79-4f69-a954-d080b6b9f7ed] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:03:24.690918 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2a9e30ce-4b07-42f3-9023-76b33951180b tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:24.691396 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2a9e30ce-4b07-42f3-9023-76b33951180b tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:24.691824 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2a9e30ce-4b07-42f3-9023-76b33951180b tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:24.692528 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2a9e30ce-4b07-42f3-9023-76b33951180b tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:24.692971 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2a9e30ce-4b07-42f3-9023-76b33951180b tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:24.693387 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2a9e30ce-4b07-42f3-9023-76b33951180b tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:24.823995 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-2a9e30ce-4b07-42f3-9023-76b33951180b tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38047508b7d44f05af7116a15ba7e319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b021c415a147e08dbfede2ddc8cc27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:03:24.831739 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-2a9e30ce-4b07-42f3-9023-76b33951180b tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/e5344f30-5e79-4f69-a954-d080b6b9f7ed" status: 200 len: 1368 microversion: 2.1 time: 0.152464 Aug 26 01:03:24.832312 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 483/970] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:03:24 2022] GET /compute/v2.1/servers/e5344f30-5e79-4f69-a954-d080b6b9f7ed => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:03:25.854653 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-4afcc19a-b266-4c9e-8829-6eae0aae5039 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:03:25.855352 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-4afcc19a-b266-4c9e-8829-6eae0aae5039 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: e5344f30-5e79-4f69-a954-d080b6b9f7ed] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:03:25.861739 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-4afcc19a-b266-4c9e-8829-6eae0aae5039 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:25.862224 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-4afcc19a-b266-4c9e-8829-6eae0aae5039 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:25.862656 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-4afcc19a-b266-4c9e-8829-6eae0aae5039 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:25.863373 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-4afcc19a-b266-4c9e-8829-6eae0aae5039 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:25.863835 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-4afcc19a-b266-4c9e-8829-6eae0aae5039 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:25.864256 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-4afcc19a-b266-4c9e-8829-6eae0aae5039 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:25.991079 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-4afcc19a-b266-4c9e-8829-6eae0aae5039 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38047508b7d44f05af7116a15ba7e319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b021c415a147e08dbfede2ddc8cc27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:03:25.998670 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-4afcc19a-b266-4c9e-8829-6eae0aae5039 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/e5344f30-5e79-4f69-a954-d080b6b9f7ed" status: 200 len: 1368 microversion: 2.1 time: 0.148686 Aug 26 01:03:25.999262 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 488/971] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:03:25 2022] GET /compute/v2.1/servers/e5344f30-5e79-4f69-a954-d080b6b9f7ed => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:03:27.019031 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-ab454ffa-6a40-41d4-b9dd-d883283bf3f0 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:03:27.019677 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-ab454ffa-6a40-41d4-b9dd-d883283bf3f0 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: e5344f30-5e79-4f69-a954-d080b6b9f7ed] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:03:27.026145 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ab454ffa-6a40-41d4-b9dd-d883283bf3f0 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:27.026654 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ab454ffa-6a40-41d4-b9dd-d883283bf3f0 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:27.027092 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ab454ffa-6a40-41d4-b9dd-d883283bf3f0 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:27.027785 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ab454ffa-6a40-41d4-b9dd-d883283bf3f0 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:27.028247 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ab454ffa-6a40-41d4-b9dd-d883283bf3f0 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:27.028702 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ab454ffa-6a40-41d4-b9dd-d883283bf3f0 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:27.155359 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-ab454ffa-6a40-41d4-b9dd-d883283bf3f0 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38047508b7d44f05af7116a15ba7e319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b021c415a147e08dbfede2ddc8cc27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:03:27.163211 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-ab454ffa-6a40-41d4-b9dd-d883283bf3f0 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/e5344f30-5e79-4f69-a954-d080b6b9f7ed" status: 200 len: 1368 microversion: 2.1 time: 0.148061 Aug 26 01:03:27.163777 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 484/972] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:03:27 2022] GET /compute/v2.1/servers/e5344f30-5e79-4f69-a954-d080b6b9f7ed => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:03:28.184524 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-f2883115-82ad-49f1-9e9b-8a41bc1d17db tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:03:28.185138 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-f2883115-82ad-49f1-9e9b-8a41bc1d17db tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: e5344f30-5e79-4f69-a954-d080b6b9f7ed] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:03:28.191513 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f2883115-82ad-49f1-9e9b-8a41bc1d17db tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:28.191995 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f2883115-82ad-49f1-9e9b-8a41bc1d17db tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:28.192428 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f2883115-82ad-49f1-9e9b-8a41bc1d17db tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:28.193141 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f2883115-82ad-49f1-9e9b-8a41bc1d17db tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:28.193588 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f2883115-82ad-49f1-9e9b-8a41bc1d17db tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:28.194009 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f2883115-82ad-49f1-9e9b-8a41bc1d17db tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:28.338485 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-f2883115-82ad-49f1-9e9b-8a41bc1d17db tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38047508b7d44f05af7116a15ba7e319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b021c415a147e08dbfede2ddc8cc27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:03:28.346442 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-f2883115-82ad-49f1-9e9b-8a41bc1d17db tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/e5344f30-5e79-4f69-a954-d080b6b9f7ed" status: 200 len: 1368 microversion: 2.1 time: 0.166340 Aug 26 01:03:28.347027 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 489/973] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:03:28 2022] GET /compute/v2.1/servers/e5344f30-5e79-4f69-a954-d080b6b9f7ed => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:03:29.367272 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-dddbfe91-c4f2-4c27-ab77-8ec65fc279de tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:03:29.367923 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-dddbfe91-c4f2-4c27-ab77-8ec65fc279de tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: e5344f30-5e79-4f69-a954-d080b6b9f7ed] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:03:29.375098 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-dddbfe91-c4f2-4c27-ab77-8ec65fc279de tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:29.375580 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-dddbfe91-c4f2-4c27-ab77-8ec65fc279de tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:29.376015 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-dddbfe91-c4f2-4c27-ab77-8ec65fc279de tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:29.376737 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-dddbfe91-c4f2-4c27-ab77-8ec65fc279de tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:29.377186 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-dddbfe91-c4f2-4c27-ab77-8ec65fc279de tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:29.377607 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-dddbfe91-c4f2-4c27-ab77-8ec65fc279de tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:29.478334 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [req-0fcf1fe6-dcd3-45f7-8f62-a7018db170f4 req-6c1839b2-30cf-481f-a463-4d7dda079584 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5344f30-5e79-4f69-a954-d080b6b9f7ed", "name": "network-vif-plugged", "status": "completed", "tag": "bd537a03-4210-4576-9d92-e96d9f5b3e29"}]} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:03:29.489659 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-0fcf1fe6-dcd3-45f7-8f62-a7018db170f4 req-6c1839b2-30cf-481f-a463-4d7dda079584 service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:29.490130 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-0fcf1fe6-dcd3-45f7-8f62-a7018db170f4 req-6c1839b2-30cf-481f-a463-4d7dda079584 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:29.490556 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-0fcf1fe6-dcd3-45f7-8f62-a7018db170f4 req-6c1839b2-30cf-481f-a463-4d7dda079584 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:29.502315 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.compute.server_external_events [req-0fcf1fe6-dcd3-45f7-8f62-a7018db170f4 req-6c1839b2-30cf-481f-a463-4d7dda079584 service nova] Creating event network-vif-plugged:bd537a03-4210-4576-9d92-e96d9f5b3e29 for instance e5344f30-5e79-4f69-a954-d080b6b9f7ed on hv-cinder-83538 Aug 26 01:03:29.507469 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [req-0fcf1fe6-dcd3-45f7-8f62-a7018db170f4 req-6c1839b2-30cf-481f-a463-4d7dda079584 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032743 Aug 26 01:03:29.508146 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 490/974] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 01:03:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 01:03:29.513207 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-dddbfe91-c4f2-4c27-ab77-8ec65fc279de tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38047508b7d44f05af7116a15ba7e319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b021c415a147e08dbfede2ddc8cc27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:03:29.520827 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-dddbfe91-c4f2-4c27-ab77-8ec65fc279de tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/e5344f30-5e79-4f69-a954-d080b6b9f7ed" status: 200 len: 1368 microversion: 2.1 time: 0.157495 Aug 26 01:03:29.521384 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 485/975] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:03:29 2022] GET /compute/v2.1/servers/e5344f30-5e79-4f69-a954-d080b6b9f7ed => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:03:30.538834 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell0:SELECT=6 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:03:30.543383 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-ab3abf3d-77de-4761-ae45-c8bdf5689f04 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:03:30.544107 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-ab3abf3d-77de-4761-ae45-c8bdf5689f04 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: e5344f30-5e79-4f69-a954-d080b6b9f7ed] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:03:30.550160 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ab3abf3d-77de-4761-ae45-c8bdf5689f04 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:30.550639 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ab3abf3d-77de-4761-ae45-c8bdf5689f04 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:30.551071 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ab3abf3d-77de-4761-ae45-c8bdf5689f04 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:30.551751 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ab3abf3d-77de-4761-ae45-c8bdf5689f04 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:30.552205 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ab3abf3d-77de-4761-ae45-c8bdf5689f04 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:30.552734 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ab3abf3d-77de-4761-ae45-c8bdf5689f04 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:30.682302 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-ab3abf3d-77de-4761-ae45-c8bdf5689f04 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38047508b7d44f05af7116a15ba7e319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b021c415a147e08dbfede2ddc8cc27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:03:30.686295 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:03:30.690792 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-ab3abf3d-77de-4761-ae45-c8bdf5689f04 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/e5344f30-5e79-4f69-a954-d080b6b9f7ed" status: 200 len: 1368 microversion: 2.1 time: 0.152923 Aug 26 01:03:30.697242 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 491/976] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:03:30 2022] GET /compute/v2.1/servers/e5344f30-5e79-4f69-a954-d080b6b9f7ed => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:03:31.711188 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-7bbfdbeb-fa19-4744-8714-024dd74e9df1 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:03:31.711748 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-7bbfdbeb-fa19-4744-8714-024dd74e9df1 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: e5344f30-5e79-4f69-a954-d080b6b9f7ed] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:03:31.713635 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell0:SELECT=2 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:03:31.714301 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell0:SELECT=6 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:03:31.719787 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7bbfdbeb-fa19-4744-8714-024dd74e9df1 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:31.720275 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7bbfdbeb-fa19-4744-8714-024dd74e9df1 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:31.720781 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7bbfdbeb-fa19-4744-8714-024dd74e9df1 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:31.727084 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7bbfdbeb-fa19-4744-8714-024dd74e9df1 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:31.727084 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7bbfdbeb-fa19-4744-8714-024dd74e9df1 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:31.727084 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7bbfdbeb-fa19-4744-8714-024dd74e9df1 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:31.856304 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-7bbfdbeb-fa19-4744-8714-024dd74e9df1 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38047508b7d44f05af7116a15ba7e319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b021c415a147e08dbfede2ddc8cc27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:03:31.864182 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-7bbfdbeb-fa19-4744-8714-024dd74e9df1 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/e5344f30-5e79-4f69-a954-d080b6b9f7ed" status: 200 len: 1559 microversion: 2.1 time: 0.156863 Aug 26 01:03:31.864789 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 486/977] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:03:31 2022] GET /compute/v2.1/servers/e5344f30-5e79-4f69-a954-d080b6b9f7ed => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:03:31.890865 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-0f16ffc1-a722-48d7-b359-03243dbe7a17 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:03:31.891367 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-0f16ffc1-a722-48d7-b359-03243dbe7a17 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: e5344f30-5e79-4f69-a954-d080b6b9f7ed] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:03:31.898184 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-0f16ffc1-a722-48d7-b359-03243dbe7a17 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:31.900822 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-0f16ffc1-a722-48d7-b359-03243dbe7a17 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:31.900822 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-0f16ffc1-a722-48d7-b359-03243dbe7a17 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:31.900822 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-0f16ffc1-a722-48d7-b359-03243dbe7a17 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:31.900822 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-0f16ffc1-a722-48d7-b359-03243dbe7a17 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:31.901189 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-0f16ffc1-a722-48d7-b359-03243dbe7a17 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:31.977002 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-0f16ffc1-a722-48d7-b359-03243dbe7a17 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/e5344f30-5e79-4f69-a954-d080b6b9f7ed/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090817 Aug 26 01:03:31.977592 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 492/978] 10.222.0.59 () {58 vars in 1275 bytes} [Fri Aug 26 01:03:31 2022] GET /compute/v2.1/servers/e5344f30-5e79-4f69-a954-d080b6b9f7ed/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:03:33.225901 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [req-d6100978-bded-4fc9-bf26-0e0690285a96 req-73445e04-3eb8-4449-803f-f125c7455a45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5344f30-5e79-4f69-a954-d080b6b9f7ed", "tag": "bd537a03-4210-4576-9d92-e96d9f5b3e29"}]} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:03:33.232021 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_api:SELECT=56,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:03:33.237601 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-d6100978-bded-4fc9-bf26-0e0690285a96 req-73445e04-3eb8-4449-803f-f125c7455a45 service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:03:33.238152 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-d6100978-bded-4fc9-bf26-0e0690285a96 req-73445e04-3eb8-4449-803f-f125c7455a45 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:03:33.238589 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-d6100978-bded-4fc9-bf26-0e0690285a96 req-73445e04-3eb8-4449-803f-f125c7455a45 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:03:33.241246 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell1:SELECT=97 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:03:33.251259 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.compute.server_external_events [req-d6100978-bded-4fc9-bf26-0e0690285a96 req-73445e04-3eb8-4449-803f-f125c7455a45 service nova] Creating event network-changed:bd537a03-4210-4576-9d92-e96d9f5b3e29 for instance e5344f30-5e79-4f69-a954-d080b6b9f7ed on hv-cinder-83538 Aug 26 01:03:33.256734 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [req-d6100978-bded-4fc9-bf26-0e0690285a96 req-73445e04-3eb8-4449-803f-f125c7455a45 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034503 Aug 26 01:03:33.257535 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 487/979] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 01:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:04:03.095121 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:04:03.096256 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 26 01:04:03.096406 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Fri Aug 26 01:04:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed (ip 10.222.0.59) !!! Aug 26 01:04:03.102291 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-893e81b4-0dcc-4ba7-8965-3b775170c047 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:04:03.102990 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [req-43aed857-ed97-461f-9a7f-94e7c4544125 req-9d389a39-1675-4e42-8732-b1d6d355c817 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed", "tag": "5db3f93c-3ea8-4e55-9a42-5db856dcb138"}]} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:04:03.103480 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-893e81b4-0dcc-4ba7-8965-3b775170c047 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: 31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:04:03.113879 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-893e81b4-0dcc-4ba7-8965-3b775170c047 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:03.114614 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-893e81b4-0dcc-4ba7-8965-3b775170c047 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:03.114774 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-893e81b4-0dcc-4ba7-8965-3b775170c047 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:03.115663 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-893e81b4-0dcc-4ba7-8965-3b775170c047 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:03.116110 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-893e81b4-0dcc-4ba7-8965-3b775170c047 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:03.116367 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-43aed857-ed97-461f-9a7f-94e7c4544125 req-9d389a39-1675-4e42-8732-b1d6d355c817 service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:03.116550 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-893e81b4-0dcc-4ba7-8965-3b775170c047 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:03.116889 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-43aed857-ed97-461f-9a7f-94e7c4544125 req-9d389a39-1675-4e42-8732-b1d6d355c817 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:03.117518 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-43aed857-ed97-461f-9a7f-94e7c4544125 req-9d389a39-1675-4e42-8732-b1d6d355c817 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:03.129235 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.compute.server_external_events [req-43aed857-ed97-461f-9a7f-94e7c4544125 req-9d389a39-1675-4e42-8732-b1d6d355c817 service nova] Creating event network-changed:5db3f93c-3ea8-4e55-9a42-5db856dcb138 for instance 31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed on hv-cinder-83538 Aug 26 01:04:03.134841 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [req-43aed857-ed97-461f-9a7f-94e7c4544125 req-9d389a39-1675-4e42-8732-b1d6d355c817 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036760 Aug 26 01:04:03.135981 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 488/980] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 01:04:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:04:03.144125 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-893e81b4-0dcc-4ba7-8965-3b775170c047 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: 31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed] Going to try to terminate instance {{(pid=127564) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 01:04:03.490017 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-893e81b4-0dcc-4ba7-8965-3b775170c047 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "DELETE /compute/v2.1/servers/31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed" status: 204 len: 0 microversion: 2.1 time: 0.396097 Aug 26 01:04:03.490609 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 493/981] 10.222.0.59 () {58 vars in 1239 bytes} [Fri Aug 26 01:04:03 2022] DELETE /compute/v2.1/servers/31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 01:04:03.501345 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-2727efed-c588-417f-94e1-5fe3eae21feb tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:04:03.501959 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-2727efed-c588-417f-94e1-5fe3eae21feb tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: 31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:04:03.508753 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2727efed-c588-417f-94e1-5fe3eae21feb tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:03.509243 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2727efed-c588-417f-94e1-5fe3eae21feb tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:03.509685 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2727efed-c588-417f-94e1-5fe3eae21feb tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:03.510371 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2727efed-c588-417f-94e1-5fe3eae21feb tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:03.510821 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2727efed-c588-417f-94e1-5fe3eae21feb tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:03.511240 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2727efed-c588-417f-94e1-5fe3eae21feb tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:03.717317 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-2727efed-c588-417f-94e1-5fe3eae21feb tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:04:03.726103 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-2727efed-c588-417f-94e1-5fe3eae21feb tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed" status: 200 len: 1580 microversion: 2.1 time: 0.229035 Aug 26 01:04:03.726689 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 489/982] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:04:03 2022] GET /compute/v2.1/servers/31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed => generated 1580 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:04:04.747729 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-c1cf8194-50ed-4726-af3c-26d293181b5a tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:04:04.748423 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-c1cf8194-50ed-4726-af3c-26d293181b5a tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: 31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:04:04.755653 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c1cf8194-50ed-4726-af3c-26d293181b5a tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:04.756224 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c1cf8194-50ed-4726-af3c-26d293181b5a tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:04.756835 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c1cf8194-50ed-4726-af3c-26d293181b5a tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:04.757385 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c1cf8194-50ed-4726-af3c-26d293181b5a tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:04.757835 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c1cf8194-50ed-4726-af3c-26d293181b5a tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:04.758256 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c1cf8194-50ed-4726-af3c-26d293181b5a tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:04.948897 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-c1cf8194-50ed-4726-af3c-26d293181b5a tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:04:04.957247 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-c1cf8194-50ed-4726-af3c-26d293181b5a tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed" status: 200 len: 1580 microversion: 2.1 time: 0.213763 Aug 26 01:04:04.957811 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 494/983] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:04:04 2022] GET /compute/v2.1/servers/31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed => generated 1580 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:04:05.954354 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [req-db6ba30a-4d8b-4dc5-8c08-537574b45998 req-8216205e-2b5e-4a89-b524-d1f38f126bb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed", "name": "network-vif-deleted", "tag": "5db3f93c-3ea8-4e55-9a42-5db856dcb138"}]} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:04:05.964093 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-db6ba30a-4d8b-4dc5-8c08-537574b45998 req-8216205e-2b5e-4a89-b524-d1f38f126bb7 service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:05.964518 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-db6ba30a-4d8b-4dc5-8c08-537574b45998 req-8216205e-2b5e-4a89-b524-d1f38f126bb7 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:05.964948 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-db6ba30a-4d8b-4dc5-8c08-537574b45998 req-8216205e-2b5e-4a89-b524-d1f38f126bb7 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:05.976371 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.compute.server_external_events [req-db6ba30a-4d8b-4dc5-8c08-537574b45998 req-8216205e-2b5e-4a89-b524-d1f38f126bb7 service nova] Creating event network-vif-deleted:5db3f93c-3ea8-4e55-9a42-5db856dcb138 for instance 31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed on hv-cinder-83538 Aug 26 01:04:05.978394 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-3d0d4ba0-c606-4d77-8298-55859122f894 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:04:05.979099 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-3d0d4ba0-c606-4d77-8298-55859122f894 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: 31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:04:05.981372 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [req-db6ba30a-4d8b-4dc5-8c08-537574b45998 req-8216205e-2b5e-4a89-b524-d1f38f126bb7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031160 Aug 26 01:04:05.981976 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 490/984] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 01:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:04:05.986272 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3d0d4ba0-c606-4d77-8298-55859122f894 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:05.986759 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3d0d4ba0-c606-4d77-8298-55859122f894 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:05.987181 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3d0d4ba0-c606-4d77-8298-55859122f894 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:05.987866 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3d0d4ba0-c606-4d77-8298-55859122f894 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:05.988307 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3d0d4ba0-c606-4d77-8298-55859122f894 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:05.988752 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3d0d4ba0-c606-4d77-8298-55859122f894 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:06.052842 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-3d0d4ba0-c606-4d77-8298-55859122f894 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:04:06.061190 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-3d0d4ba0-c606-4d77-8298-55859122f894 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed" status: 200 len: 1393 microversion: 2.1 time: 0.086763 Aug 26 01:04:06.061760 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 495/985] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:04:05 2022] GET /compute/v2.1/servers/31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed => generated 1393 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 01:04:07.083154 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-478ea8c5-3305-4d24-83b9-39758864924e tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:04:07.085655 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-478ea8c5-3305-4d24-83b9-39758864924e tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: 31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:04:07.090086 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-478ea8c5-3305-4d24-83b9-39758864924e tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:07.090568 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-478ea8c5-3305-4d24-83b9-39758864924e tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:07.091011 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-478ea8c5-3305-4d24-83b9-39758864924e tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:07.091695 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-478ea8c5-3305-4d24-83b9-39758864924e tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:07.092149 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-478ea8c5-3305-4d24-83b9-39758864924e tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:07.092601 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-478ea8c5-3305-4d24-83b9-39758864924e tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:07.123626 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-478ea8c5-3305-4d24-83b9-39758864924e tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:07.124104 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-478ea8c5-3305-4d24-83b9-39758864924e tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:07.124571 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-478ea8c5-3305-4d24-83b9-39758864924e tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:07.125014 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.objects.instance [None req-478ea8c5-3305-4d24-83b9-39758864924e tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lazy-loading 'fault' on Instance uuid 31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed {{(pid=127565) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 01:04:07.166046 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-478ea8c5-3305-4d24-83b9-39758864924e tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:04:07.174498 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-478ea8c5-3305-4d24-83b9-39758864924e tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed" status: 200 len: 1231 microversion: 2.1 time: 0.096027 Aug 26 01:04:07.175059 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 491/986] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:04:07 2022] GET /compute/v2.1/servers/31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed => generated 1231 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:04:08.195103 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-bc8ebd5f-3eed-4750-9594-0c63fe7e4dc0 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:04:08.195641 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-bc8ebd5f-3eed-4750-9594-0c63fe7e4dc0 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: 31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:04:08.202008 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bc8ebd5f-3eed-4750-9594-0c63fe7e4dc0 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:08.202491 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bc8ebd5f-3eed-4750-9594-0c63fe7e4dc0 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:08.202924 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bc8ebd5f-3eed-4750-9594-0c63fe7e4dc0 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:08.203607 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bc8ebd5f-3eed-4750-9594-0c63fe7e4dc0 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:08.204057 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bc8ebd5f-3eed-4750-9594-0c63fe7e4dc0 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:08.204491 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bc8ebd5f-3eed-4750-9594-0c63fe7e4dc0 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:08.219931 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.wsgi [None req-bc8ebd5f-3eed-4750-9594-0c63fe7e4dc0 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] HTTP exception thrown: Instance 31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed could not be found. Aug 26 01:04:08.221571 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-bc8ebd5f-3eed-4750-9594-0c63fe7e4dc0 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Request method failure captured: Aug 26 01:04:08.221571 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: request: GET /compute/v2.1/servers/31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed HTTP/1.1 Aug 26 01:04:08.221571 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Accept: application/json Aug 26 01:04:08.221571 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Accept-Encoding: identity Aug 26 01:04:08.221571 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Connection: close Aug 26 01:04:08.221571 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Content-Length: 0 Aug 26 01:04:08.221571 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Content-Type: application/json Aug 26 01:04:08.221571 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Host: 10.222.0.59 Aug 26 01:04:08.221571 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Openstack-System-Scope: None Aug 26 01:04:08.221571 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: User-Agent: python-urllib3/1.26.11 Aug 26 01:04:08.221571 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Auth-Token: gAAAAABjCBoQXDWgoIb8avBen_z7Yf4_X8lqQ4VhhdT4yopA3Omw06PWCCz09WXxNlA3d2mYMlvzrhuLGI89Oc1N5Vz9Y9ZKC004wdTzeie7QqFxXr85uqHzon1wox-7MHX6GOXDXm_hj_-g35MbQ1_gC1gpHFV94VF0fAsvAKXUCNgo4yFtyTo Aug 26 01:04:08.221571 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Domain-Id: None Aug 26 01:04:08.221571 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Domain-Name: None Aug 26 01:04:08.221571 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Identity-Status: Confirmed Aug 26 01:04:08.221571 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Is-Admin-Project: True Aug 26 01:04:08.221571 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Domain-Id: default Aug 26 01:04:08.221571 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Domain-Name: Default Aug 26 01:04:08.221571 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Id: ca3e24d51bdf44c5ad7219fa57d3d23b Aug 26 01:04:08.221571 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Name: tempest-TestVolumeBootPattern-2142040423 Aug 26 01:04:08.221571 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Role: reader,member Aug 26 01:04:08.221571 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Roles: reader,member Aug 26 01:04:08.223313 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ca3e24d51bdf44c5ad7219fa57d3d23b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ca3e24d51bdf44c5ad7219fa57d3d23b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ca3e24d51bdf44c5ad7219fa57d3d23b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ca3e24d51bdf44c5ad7219fa57d3d23b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 01:04:08.223313 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant: tempest-TestVolumeBootPattern-2142040423 Aug 26 01:04:08.223313 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant-Id: ca3e24d51bdf44c5ad7219fa57d3d23b Aug 26 01:04:08.223313 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant-Name: tempest-TestVolumeBootPattern-2142040423 Aug 26 01:04:08.223313 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User: tempest-TestVolumeBootPattern-2142040423-project Aug 26 01:04:08.223313 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Domain-Id: default Aug 26 01:04:08.223313 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Domain-Name: Default Aug 26 01:04:08.223313 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Id: cd45f1813efc4926a30454aaa108ac47 Aug 26 01:04:08.223313 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Name: tempest-TestVolumeBootPattern-2142040423-project Aug 26 01:04:08.223313 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: method: > Aug 26 01:04:08.223313 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: exception: Instance 31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed could not be found. Aug 26 01:04:08.223313 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: action_args: {'id': '31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed'} Aug 26 01:04:08.224432 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 01:04:08.224432 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:04:08.224432 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 01:04:08.224432 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 01:04:08.224432 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 01:04:08.224432 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 01:04:08.224432 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 01:04:08.224432 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 01:04:08.224432 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 01:04:08.224432 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 01:04:08.224432 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed could not be found. Aug 26 01:04:08.224432 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:04:08.224432 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:04:08.224432 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:04:08.224432 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:04:08.224432 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:04:08.224432 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:04:08.224432 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 01:04:08.224432 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 01:04:08.224432 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 01:04:08.226126 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 01:04:08.226126 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 01:04:08.226126 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 01:04:08.226126 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 01:04:08.226126 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 01:04:08.226126 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 01:04:08.226126 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 01:04:08.226126 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed could not be found. Aug 26 01:04:08.226126 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:04:08.226126 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:04:08.226126 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:04:08.226126 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:04:08.226126 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:04:08.226126 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:04:08.226126 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 01:04:08.226126 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 01:04:08.226126 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed could not be found. Aug 26 01:04:08.226126 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:04:08.227636 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-bc8ebd5f-3eed-4750-9594-0c63fe7e4dc0 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Returning 404 to user: Instance 31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed could not be found. {{(pid=127564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 01:04:08.227636 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-bc8ebd5f-3eed-4750-9594-0c63fe7e4dc0 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed" status: 404 len: 111 microversion: 2.1 time: 0.031725 Aug 26 01:04:08.227636 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 496/987] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:04:08 2022] GET /compute/v2.1/servers/31b44a5a-b5a1-4e8a-b7fa-9a2ffe1b84ed => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 01:04:09.029295 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-d631974f-3a6b-4795-ab36-ca3f348dcb02 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:04:09.029870 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-d631974f-3a6b-4795-ab36-ca3f348dcb02 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: e5344f30-5e79-4f69-a954-d080b6b9f7ed] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:04:09.037280 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d631974f-3a6b-4795-ab36-ca3f348dcb02 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:09.037764 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d631974f-3a6b-4795-ab36-ca3f348dcb02 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:09.038204 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d631974f-3a6b-4795-ab36-ca3f348dcb02 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:09.038897 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d631974f-3a6b-4795-ab36-ca3f348dcb02 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:09.039351 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d631974f-3a6b-4795-ab36-ca3f348dcb02 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:09.039776 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d631974f-3a6b-4795-ab36-ca3f348dcb02 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:09.062749 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-d631974f-3a6b-4795-ab36-ca3f348dcb02 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/e5344f30-5e79-4f69-a954-d080b6b9f7ed/ips" status: 200 len: 151 microversion: 2.1 time: 0.037376 Aug 26 01:04:09.063316 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 492/988] 10.222.0.59 () {58 vars in 1248 bytes} [Fri Aug 26 01:04:09 2022] GET /compute/v2.1/servers/e5344f30-5e79-4f69-a954-d080b6b9f7ed/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:04:10.769022 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-fea5a3c1-9f0b-4c85-bc11-73e4303977f1 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "447e8991-d58c-450d-90dc-9eeaaf05a581"}} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:04:10.771397 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-fea5a3c1-9f0b-4c85-bc11-73e4303977f1 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: e5344f30-5e79-4f69-a954-d080b6b9f7ed] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:04:10.777833 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fea5a3c1-9f0b-4c85-bc11-73e4303977f1 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:10.778308 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fea5a3c1-9f0b-4c85-bc11-73e4303977f1 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:10.778734 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fea5a3c1-9f0b-4c85-bc11-73e4303977f1 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:10.779412 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fea5a3c1-9f0b-4c85-bc11-73e4303977f1 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:10.779855 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fea5a3c1-9f0b-4c85-bc11-73e4303977f1 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:10.780269 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fea5a3c1-9f0b-4c85-bc11-73e4303977f1 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:11.625777 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-fea5a3c1-9f0b-4c85-bc11-73e4303977f1 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "POST /compute/v2.1/servers/e5344f30-5e79-4f69-a954-d080b6b9f7ed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.854649 Aug 26 01:04:11.628097 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-ddff3447-759a-41a4-97cd-59b6ced971d4 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:04:11.629266 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-ddff3447-759a-41a4-97cd-59b6ced971d4 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: 8638d924-308a-4f2b-945e-5798c738ee45] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:04:11.636559 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 497/989] 10.222.0.59 () {60 vars in 1323 bytes} [Fri Aug 26 01:04:10 2022] POST /compute/v2.1/servers/e5344f30-5e79-4f69-a954-d080b6b9f7ed/os-volume_attachments => generated 194 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:04:11.640134 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ddff3447-759a-41a4-97cd-59b6ced971d4 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:11.641759 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ddff3447-759a-41a4-97cd-59b6ced971d4 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:11.642678 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ddff3447-759a-41a4-97cd-59b6ced971d4 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:11.643732 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ddff3447-759a-41a4-97cd-59b6ced971d4 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:11.644422 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ddff3447-759a-41a4-97cd-59b6ced971d4 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:11.645547 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ddff3447-759a-41a4-97cd-59b6ced971d4 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:11.650364 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [req-c26d1f72-d370-49c7-ab13-cb80036515b8 req-e524dc54-ce60-47a5-bce1-00a754be2694 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8638d924-308a-4f2b-945e-5798c738ee45", "tag": "ea9f0339-afc5-4a08-9e7f-4f43f30fd859"}]} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:04:11.660393 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-c26d1f72-d370-49c7-ab13-cb80036515b8 req-e524dc54-ce60-47a5-bce1-00a754be2694 service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:11.661030 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-c26d1f72-d370-49c7-ab13-cb80036515b8 req-e524dc54-ce60-47a5-bce1-00a754be2694 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:11.661364 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-c26d1f72-d370-49c7-ab13-cb80036515b8 req-e524dc54-ce60-47a5-bce1-00a754be2694 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:11.683887 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.compute.server_external_events [req-c26d1f72-d370-49c7-ab13-cb80036515b8 req-e524dc54-ce60-47a5-bce1-00a754be2694 service nova] Creating event network-changed:ea9f0339-afc5-4a08-9e7f-4f43f30fd859 for instance 8638d924-308a-4f2b-945e-5798c738ee45 on hv-cinder-83538 Aug 26 01:04:11.686459 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-ddff3447-759a-41a4-97cd-59b6ced971d4 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: 8638d924-308a-4f2b-945e-5798c738ee45] Going to try to terminate instance {{(pid=127565) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 01:04:11.689677 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [req-c26d1f72-d370-49c7-ab13-cb80036515b8 req-e524dc54-ce60-47a5-bce1-00a754be2694 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050285 Aug 26 01:04:11.690919 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 498/990] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 01:04:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:04:12.005566 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-ddff3447-759a-41a4-97cd-59b6ced971d4 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "DELETE /compute/v2.1/servers/8638d924-308a-4f2b-945e-5798c738ee45" status: 204 len: 0 microversion: 2.1 time: 0.382649 Aug 26 01:04:12.009267 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 493/991] 10.222.0.59 () {58 vars in 1239 bytes} [Fri Aug 26 01:04:11 2022] DELETE /compute/v2.1/servers/8638d924-308a-4f2b-945e-5798c738ee45 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 26 01:04:12.015100 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-cc2f5b31-791e-4734-a9b4-a9ba31d49bac tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:04:12.015892 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-cc2f5b31-791e-4734-a9b4-a9ba31d49bac tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: 8638d924-308a-4f2b-945e-5798c738ee45] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:04:12.022713 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-cc2f5b31-791e-4734-a9b4-a9ba31d49bac tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:12.023194 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-cc2f5b31-791e-4734-a9b4-a9ba31d49bac tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:12.023626 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-cc2f5b31-791e-4734-a9b4-a9ba31d49bac tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:12.024561 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-cc2f5b31-791e-4734-a9b4-a9ba31d49bac tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:12.024973 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-cc2f5b31-791e-4734-a9b4-a9ba31d49bac tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:12.025396 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-cc2f5b31-791e-4734-a9b4-a9ba31d49bac tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:12.166559 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-cc2f5b31-791e-4734-a9b4-a9ba31d49bac tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:04:12.175736 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-cc2f5b31-791e-4734-a9b4-a9ba31d49bac tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/8638d924-308a-4f2b-945e-5798c738ee45" status: 200 len: 1579 microversion: 2.1 time: 0.165007 Aug 26 01:04:12.179372 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 499/992] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:04:12 2022] GET /compute/v2.1/servers/8638d924-308a-4f2b-945e-5798c738ee45 => generated 1579 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 01:04:13.198669 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-7dad5a6d-4b90-4eb1-b6fc-cf1442f03e34 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:04:13.199284 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-7dad5a6d-4b90-4eb1-b6fc-cf1442f03e34 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: 8638d924-308a-4f2b-945e-5798c738ee45] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:04:13.205722 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7dad5a6d-4b90-4eb1-b6fc-cf1442f03e34 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:13.206202 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7dad5a6d-4b90-4eb1-b6fc-cf1442f03e34 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:13.206646 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7dad5a6d-4b90-4eb1-b6fc-cf1442f03e34 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:13.207329 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7dad5a6d-4b90-4eb1-b6fc-cf1442f03e34 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:13.207778 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7dad5a6d-4b90-4eb1-b6fc-cf1442f03e34 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:13.208204 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7dad5a6d-4b90-4eb1-b6fc-cf1442f03e34 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:13.342536 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-7dad5a6d-4b90-4eb1-b6fc-cf1442f03e34 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:04:13.350343 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-7dad5a6d-4b90-4eb1-b6fc-cf1442f03e34 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/8638d924-308a-4f2b-945e-5798c738ee45" status: 200 len: 1579 microversion: 2.1 time: 0.155982 Aug 26 01:04:13.350900 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 494/993] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:04:13 2022] GET /compute/v2.1/servers/8638d924-308a-4f2b-945e-5798c738ee45 => generated 1579 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:04:14.371493 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-029ff0c4-aba2-404c-b401-a7984c43e3d8 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:04:14.372108 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-029ff0c4-aba2-404c-b401-a7984c43e3d8 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: 8638d924-308a-4f2b-945e-5798c738ee45] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:04:14.379466 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-029ff0c4-aba2-404c-b401-a7984c43e3d8 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:14.379945 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-029ff0c4-aba2-404c-b401-a7984c43e3d8 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:14.380392 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-029ff0c4-aba2-404c-b401-a7984c43e3d8 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:14.381112 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-029ff0c4-aba2-404c-b401-a7984c43e3d8 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:14.381661 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-029ff0c4-aba2-404c-b401-a7984c43e3d8 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:14.382043 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-029ff0c4-aba2-404c-b401-a7984c43e3d8 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:14.578109 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [req-2e717166-7d75-462f-bd5a-5e4e29504d2d req-b6956142-0a23-4289-bb07-698024c4fb04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8638d924-308a-4f2b-945e-5798c738ee45", "name": "network-vif-deleted", "tag": "ea9f0339-afc5-4a08-9e7f-4f43f30fd859"}]} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:04:14.588939 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-2e717166-7d75-462f-bd5a-5e4e29504d2d req-b6956142-0a23-4289-bb07-698024c4fb04 service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:14.593483 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-2e717166-7d75-462f-bd5a-5e4e29504d2d req-b6956142-0a23-4289-bb07-698024c4fb04 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:14.593483 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-2e717166-7d75-462f-bd5a-5e4e29504d2d req-b6956142-0a23-4289-bb07-698024c4fb04 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:14.597396 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-029ff0c4-aba2-404c-b401-a7984c43e3d8 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:04:14.602355 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.compute.server_external_events [req-2e717166-7d75-462f-bd5a-5e4e29504d2d req-b6956142-0a23-4289-bb07-698024c4fb04 service nova] Creating event network-vif-deleted:ea9f0339-afc5-4a08-9e7f-4f43f30fd859 for instance 8638d924-308a-4f2b-945e-5798c738ee45 on hv-cinder-83538 Aug 26 01:04:14.606675 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-029ff0c4-aba2-404c-b401-a7984c43e3d8 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/8638d924-308a-4f2b-945e-5798c738ee45" status: 200 len: 1460 microversion: 2.1 time: 0.239012 Aug 26 01:04:14.608080 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 500/994] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:04:14 2022] GET /compute/v2.1/servers/8638d924-308a-4f2b-945e-5798c738ee45 => generated 1460 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:04:14.609070 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [req-2e717166-7d75-462f-bd5a-5e4e29504d2d req-b6956142-0a23-4289-bb07-698024c4fb04 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034695 Aug 26 01:04:14.609663 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 495/995] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 01:04:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 01:04:15.629464 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-d1436932-8405-4e3f-b1b6-ccf7c7f01aec tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:04:15.630102 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-d1436932-8405-4e3f-b1b6-ccf7c7f01aec tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: 8638d924-308a-4f2b-945e-5798c738ee45] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:04:15.636561 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-d1436932-8405-4e3f-b1b6-ccf7c7f01aec tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:15.637061 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-d1436932-8405-4e3f-b1b6-ccf7c7f01aec tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:15.637484 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-d1436932-8405-4e3f-b1b6-ccf7c7f01aec tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:15.638169 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-d1436932-8405-4e3f-b1b6-ccf7c7f01aec tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:15.638624 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-d1436932-8405-4e3f-b1b6-ccf7c7f01aec tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:15.639047 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-d1436932-8405-4e3f-b1b6-ccf7c7f01aec tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:15.669486 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-d1436932-8405-4e3f-b1b6-ccf7c7f01aec tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:15.669891 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-d1436932-8405-4e3f-b1b6-ccf7c7f01aec tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:15.670325 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-d1436932-8405-4e3f-b1b6-ccf7c7f01aec tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:15.670772 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.objects.instance [None req-d1436932-8405-4e3f-b1b6-ccf7c7f01aec tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lazy-loading 'fault' on Instance uuid 8638d924-308a-4f2b-945e-5798c738ee45 {{(pid=127564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 01:04:15.711474 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-d1436932-8405-4e3f-b1b6-ccf7c7f01aec tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd45f1813efc4926a30454aaa108ac47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e24d51bdf44c5ad7219fa57d3d23b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:04:15.720533 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-d1436932-8405-4e3f-b1b6-ccf7c7f01aec tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/8638d924-308a-4f2b-945e-5798c738ee45" status: 200 len: 1231 microversion: 2.1 time: 0.095393 Aug 26 01:04:15.721131 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 501/996] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:04:15 2022] GET /compute/v2.1/servers/8638d924-308a-4f2b-945e-5798c738ee45 => generated 1231 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:04:16.743138 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-a482bbbc-69bf-4e6b-98d5-41916f834750 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:04:16.743760 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-a482bbbc-69bf-4e6b-98d5-41916f834750 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: 8638d924-308a-4f2b-945e-5798c738ee45] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:04:16.750457 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a482bbbc-69bf-4e6b-98d5-41916f834750 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:16.750949 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a482bbbc-69bf-4e6b-98d5-41916f834750 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:16.751384 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a482bbbc-69bf-4e6b-98d5-41916f834750 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:16.752066 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a482bbbc-69bf-4e6b-98d5-41916f834750 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:16.752550 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a482bbbc-69bf-4e6b-98d5-41916f834750 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:16.752978 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a482bbbc-69bf-4e6b-98d5-41916f834750 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:16.766715 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.wsgi [None req-a482bbbc-69bf-4e6b-98d5-41916f834750 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] HTTP exception thrown: Instance 8638d924-308a-4f2b-945e-5798c738ee45 could not be found. Aug 26 01:04:16.768325 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-a482bbbc-69bf-4e6b-98d5-41916f834750 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Request method failure captured: Aug 26 01:04:16.768325 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: request: GET /compute/v2.1/servers/8638d924-308a-4f2b-945e-5798c738ee45 HTTP/1.1 Aug 26 01:04:16.768325 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Accept: application/json Aug 26 01:04:16.768325 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Accept-Encoding: identity Aug 26 01:04:16.768325 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Connection: close Aug 26 01:04:16.768325 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Content-Length: 0 Aug 26 01:04:16.768325 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Content-Type: application/json Aug 26 01:04:16.768325 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Host: 10.222.0.59 Aug 26 01:04:16.768325 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Openstack-System-Scope: None Aug 26 01:04:16.768325 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: User-Agent: python-urllib3/1.26.11 Aug 26 01:04:16.768325 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Auth-Token: gAAAAABjCBoQXDWgoIb8avBen_z7Yf4_X8lqQ4VhhdT4yopA3Omw06PWCCz09WXxNlA3d2mYMlvzrhuLGI89Oc1N5Vz9Y9ZKC004wdTzeie7QqFxXr85uqHzon1wox-7MHX6GOXDXm_hj_-g35MbQ1_gC1gpHFV94VF0fAsvAKXUCNgo4yFtyTo Aug 26 01:04:16.768325 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Domain-Id: None Aug 26 01:04:16.768325 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Domain-Name: None Aug 26 01:04:16.768325 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Identity-Status: Confirmed Aug 26 01:04:16.768325 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Is-Admin-Project: True Aug 26 01:04:16.768325 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Domain-Id: default Aug 26 01:04:16.768325 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Domain-Name: Default Aug 26 01:04:16.768325 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Id: ca3e24d51bdf44c5ad7219fa57d3d23b Aug 26 01:04:16.768325 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Name: tempest-TestVolumeBootPattern-2142040423 Aug 26 01:04:16.768325 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Role: reader,member Aug 26 01:04:16.768325 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Roles: reader,member Aug 26 01:04:16.770046 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ca3e24d51bdf44c5ad7219fa57d3d23b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ca3e24d51bdf44c5ad7219fa57d3d23b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ca3e24d51bdf44c5ad7219fa57d3d23b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ca3e24d51bdf44c5ad7219fa57d3d23b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 01:04:16.770046 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant: tempest-TestVolumeBootPattern-2142040423 Aug 26 01:04:16.770046 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant-Id: ca3e24d51bdf44c5ad7219fa57d3d23b Aug 26 01:04:16.770046 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant-Name: tempest-TestVolumeBootPattern-2142040423 Aug 26 01:04:16.770046 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User: tempest-TestVolumeBootPattern-2142040423-project Aug 26 01:04:16.770046 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Domain-Id: default Aug 26 01:04:16.770046 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Domain-Name: Default Aug 26 01:04:16.770046 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Id: cd45f1813efc4926a30454aaa108ac47 Aug 26 01:04:16.770046 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Name: tempest-TestVolumeBootPattern-2142040423-project Aug 26 01:04:16.770046 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: method: > Aug 26 01:04:16.770046 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: exception: Instance 8638d924-308a-4f2b-945e-5798c738ee45 could not be found. Aug 26 01:04:16.770046 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: action_args: {'id': '8638d924-308a-4f2b-945e-5798c738ee45'} Aug 26 01:04:16.771158 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 01:04:16.771158 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:04:16.771158 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 01:04:16.771158 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 01:04:16.771158 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 01:04:16.771158 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 01:04:16.771158 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 01:04:16.771158 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 01:04:16.771158 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 01:04:16.771158 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 01:04:16.771158 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8638d924-308a-4f2b-945e-5798c738ee45 could not be found. Aug 26 01:04:16.771158 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:04:16.771158 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:04:16.771158 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:04:16.771158 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:04:16.771158 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:04:16.771158 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:04:16.771158 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 01:04:16.771158 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 01:04:16.771158 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 01:04:16.772807 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 01:04:16.772807 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 01:04:16.772807 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 01:04:16.772807 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 01:04:16.772807 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 01:04:16.772807 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 01:04:16.772807 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 01:04:16.772807 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8638d924-308a-4f2b-945e-5798c738ee45 could not be found. Aug 26 01:04:16.772807 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:04:16.772807 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:04:16.772807 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:04:16.772807 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:04:16.772807 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:04:16.772807 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:04:16.772807 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 01:04:16.772807 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 01:04:16.772807 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8638d924-308a-4f2b-945e-5798c738ee45 could not be found. Aug 26 01:04:16.772807 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:04:16.774330 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-a482bbbc-69bf-4e6b-98d5-41916f834750 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Returning 404 to user: Instance 8638d924-308a-4f2b-945e-5798c738ee45 could not be found. {{(pid=127565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 01:04:16.774330 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-a482bbbc-69bf-4e6b-98d5-41916f834750 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/8638d924-308a-4f2b-945e-5798c738ee45" status: 404 len: 111 microversion: 2.1 time: 0.031422 Aug 26 01:04:16.774330 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 496/997] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:04:16 2022] GET /compute/v2.1/servers/8638d924-308a-4f2b-945e-5798c738ee45 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 01:04:17.296314 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-e45229c1-9855-49e2-bf9a-181146040cc7 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:04:17.296915 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-e45229c1-9855-49e2-bf9a-181146040cc7 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: cc9ceee0-65b5-48be-8dcc-7ec2a992f72d] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:04:17.303951 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e45229c1-9855-49e2-bf9a-181146040cc7 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:17.304433 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e45229c1-9855-49e2-bf9a-181146040cc7 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:17.304918 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e45229c1-9855-49e2-bf9a-181146040cc7 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:17.305608 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e45229c1-9855-49e2-bf9a-181146040cc7 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:17.306060 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e45229c1-9855-49e2-bf9a-181146040cc7 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:17.306504 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e45229c1-9855-49e2-bf9a-181146040cc7 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:17.319701 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.wsgi [None req-e45229c1-9855-49e2-bf9a-181146040cc7 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] HTTP exception thrown: Instance cc9ceee0-65b5-48be-8dcc-7ec2a992f72d could not be found. Aug 26 01:04:17.321355 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-e45229c1-9855-49e2-bf9a-181146040cc7 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Request method failure captured: Aug 26 01:04:17.321355 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: request: DELETE /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d HTTP/1.1 Aug 26 01:04:17.321355 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Accept: application/json Aug 26 01:04:17.321355 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Accept-Encoding: identity Aug 26 01:04:17.321355 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Connection: close Aug 26 01:04:17.321355 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Content-Length: 0 Aug 26 01:04:17.321355 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Content-Type: application/json Aug 26 01:04:17.321355 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Host: 10.222.0.59 Aug 26 01:04:17.321355 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Openstack-System-Scope: None Aug 26 01:04:17.321355 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: User-Agent: python-urllib3/1.26.11 Aug 26 01:04:17.321355 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Auth-Token: gAAAAABjCBoQXDWgoIb8avBen_z7Yf4_X8lqQ4VhhdT4yopA3Omw06PWCCz09WXxNlA3d2mYMlvzrhuLGI89Oc1N5Vz9Y9ZKC004wdTzeie7QqFxXr85uqHzon1wox-7MHX6GOXDXm_hj_-g35MbQ1_gC1gpHFV94VF0fAsvAKXUCNgo4yFtyTo Aug 26 01:04:17.321355 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Domain-Id: None Aug 26 01:04:17.321355 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Domain-Name: None Aug 26 01:04:17.321355 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Identity-Status: Confirmed Aug 26 01:04:17.321355 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Is-Admin-Project: True Aug 26 01:04:17.321355 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Domain-Id: default Aug 26 01:04:17.321355 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Domain-Name: Default Aug 26 01:04:17.321355 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Id: ca3e24d51bdf44c5ad7219fa57d3d23b Aug 26 01:04:17.321355 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Name: tempest-TestVolumeBootPattern-2142040423 Aug 26 01:04:17.321355 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Role: reader,member Aug 26 01:04:17.321355 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Roles: reader,member Aug 26 01:04:17.323002 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ca3e24d51bdf44c5ad7219fa57d3d23b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ca3e24d51bdf44c5ad7219fa57d3d23b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ca3e24d51bdf44c5ad7219fa57d3d23b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ca3e24d51bdf44c5ad7219fa57d3d23b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 01:04:17.323002 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant: tempest-TestVolumeBootPattern-2142040423 Aug 26 01:04:17.323002 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant-Id: ca3e24d51bdf44c5ad7219fa57d3d23b Aug 26 01:04:17.323002 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant-Name: tempest-TestVolumeBootPattern-2142040423 Aug 26 01:04:17.323002 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User: tempest-TestVolumeBootPattern-2142040423-project Aug 26 01:04:17.323002 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Domain-Id: default Aug 26 01:04:17.323002 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Domain-Name: Default Aug 26 01:04:17.323002 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Id: cd45f1813efc4926a30454aaa108ac47 Aug 26 01:04:17.323002 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Name: tempest-TestVolumeBootPattern-2142040423-project Aug 26 01:04:17.323002 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: method: > Aug 26 01:04:17.323002 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: exception: Instance cc9ceee0-65b5-48be-8dcc-7ec2a992f72d could not be found. Aug 26 01:04:17.323002 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: action_args: {'id': 'cc9ceee0-65b5-48be-8dcc-7ec2a992f72d'} Aug 26 01:04:17.323943 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 01:04:17.323943 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:04:17.323943 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 01:04:17.323943 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 01:04:17.323943 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 01:04:17.323943 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 01:04:17.323943 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 01:04:17.323943 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 01:04:17.323943 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 01:04:17.323943 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 01:04:17.323943 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc9ceee0-65b5-48be-8dcc-7ec2a992f72d could not be found. Aug 26 01:04:17.323943 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:04:17.323943 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:04:17.323943 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:04:17.323943 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:04:17.323943 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:04:17.323943 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:04:17.323943 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 01:04:17.323943 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 01:04:17.323943 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 01:04:17.325594 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 01:04:17.325594 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 01:04:17.325594 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 01:04:17.325594 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 01:04:17.325594 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 01:04:17.325594 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 01:04:17.325594 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 01:04:17.325594 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 01:04:17.325594 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 01:04:17.325594 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc9ceee0-65b5-48be-8dcc-7ec2a992f72d could not be found. Aug 26 01:04:17.325594 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:04:17.325594 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:04:17.325594 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:04:17.325594 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:04:17.325594 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:04:17.325594 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:04:17.325594 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 01:04:17.325594 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 01:04:17.325594 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc9ceee0-65b5-48be-8dcc-7ec2a992f72d could not be found. Aug 26 01:04:17.325594 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:04:17.327137 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-e45229c1-9855-49e2-bf9a-181146040cc7 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Returning 404 to user: Instance cc9ceee0-65b5-48be-8dcc-7ec2a992f72d could not be found. {{(pid=127564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 01:04:17.327137 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-e45229c1-9855-49e2-bf9a-181146040cc7 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "DELETE /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d" status: 404 len: 111 microversion: 2.1 time: 0.030362 Aug 26 01:04:17.327137 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 502/998] 10.222.0.59 () {58 vars in 1239 bytes} [Fri Aug 26 01:04:17 2022] DELETE /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 01:04:17.331609 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-5a888adf-145c-47f2-aaaa-05de1c4bd594 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:04:17.332218 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-5a888adf-145c-47f2-aaaa-05de1c4bd594 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] [instance: cc9ceee0-65b5-48be-8dcc-7ec2a992f72d] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:04:17.338313 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5a888adf-145c-47f2-aaaa-05de1c4bd594 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:17.338795 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5a888adf-145c-47f2-aaaa-05de1c4bd594 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:17.339224 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5a888adf-145c-47f2-aaaa-05de1c4bd594 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:17.339898 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5a888adf-145c-47f2-aaaa-05de1c4bd594 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:17.340340 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5a888adf-145c-47f2-aaaa-05de1c4bd594 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:17.340782 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5a888adf-145c-47f2-aaaa-05de1c4bd594 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:17.354503 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.wsgi [None req-5a888adf-145c-47f2-aaaa-05de1c4bd594 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] HTTP exception thrown: Instance cc9ceee0-65b5-48be-8dcc-7ec2a992f72d could not be found. Aug 26 01:04:17.355993 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-5a888adf-145c-47f2-aaaa-05de1c4bd594 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Request method failure captured: Aug 26 01:04:17.355993 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: request: GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d HTTP/1.1 Aug 26 01:04:17.355993 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Accept: application/json Aug 26 01:04:17.355993 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Accept-Encoding: identity Aug 26 01:04:17.355993 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Connection: close Aug 26 01:04:17.355993 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Content-Length: 0 Aug 26 01:04:17.355993 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Content-Type: application/json Aug 26 01:04:17.355993 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Host: 10.222.0.59 Aug 26 01:04:17.355993 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Openstack-System-Scope: None Aug 26 01:04:17.355993 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: User-Agent: python-urllib3/1.26.11 Aug 26 01:04:17.355993 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Auth-Token: gAAAAABjCBoQXDWgoIb8avBen_z7Yf4_X8lqQ4VhhdT4yopA3Omw06PWCCz09WXxNlA3d2mYMlvzrhuLGI89Oc1N5Vz9Y9ZKC004wdTzeie7QqFxXr85uqHzon1wox-7MHX6GOXDXm_hj_-g35MbQ1_gC1gpHFV94VF0fAsvAKXUCNgo4yFtyTo Aug 26 01:04:17.355993 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Domain-Id: None Aug 26 01:04:17.355993 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Domain-Name: None Aug 26 01:04:17.355993 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Identity-Status: Confirmed Aug 26 01:04:17.355993 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Is-Admin-Project: True Aug 26 01:04:17.355993 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Domain-Id: default Aug 26 01:04:17.355993 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Domain-Name: Default Aug 26 01:04:17.355993 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Id: ca3e24d51bdf44c5ad7219fa57d3d23b Aug 26 01:04:17.355993 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Name: tempest-TestVolumeBootPattern-2142040423 Aug 26 01:04:17.355993 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Role: reader,member Aug 26 01:04:17.355993 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Roles: reader,member Aug 26 01:04:17.357623 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ca3e24d51bdf44c5ad7219fa57d3d23b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ca3e24d51bdf44c5ad7219fa57d3d23b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ca3e24d51bdf44c5ad7219fa57d3d23b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ca3e24d51bdf44c5ad7219fa57d3d23b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 01:04:17.357623 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant: tempest-TestVolumeBootPattern-2142040423 Aug 26 01:04:17.357623 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant-Id: ca3e24d51bdf44c5ad7219fa57d3d23b Aug 26 01:04:17.357623 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant-Name: tempest-TestVolumeBootPattern-2142040423 Aug 26 01:04:17.357623 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User: tempest-TestVolumeBootPattern-2142040423-project Aug 26 01:04:17.357623 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Domain-Id: default Aug 26 01:04:17.357623 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Domain-Name: Default Aug 26 01:04:17.357623 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Id: cd45f1813efc4926a30454aaa108ac47 Aug 26 01:04:17.357623 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Name: tempest-TestVolumeBootPattern-2142040423-project Aug 26 01:04:17.357623 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: method: > Aug 26 01:04:17.357623 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: exception: Instance cc9ceee0-65b5-48be-8dcc-7ec2a992f72d could not be found. Aug 26 01:04:17.357623 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: action_args: {'id': 'cc9ceee0-65b5-48be-8dcc-7ec2a992f72d'} Aug 26 01:04:17.358804 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 01:04:17.358804 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:04:17.358804 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 01:04:17.358804 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 01:04:17.358804 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 01:04:17.358804 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 01:04:17.358804 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 01:04:17.358804 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 01:04:17.358804 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 01:04:17.358804 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 01:04:17.358804 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc9ceee0-65b5-48be-8dcc-7ec2a992f72d could not be found. Aug 26 01:04:17.358804 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:04:17.358804 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:04:17.358804 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:04:17.358804 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:04:17.358804 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:04:17.358804 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:04:17.358804 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 01:04:17.358804 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 01:04:17.358804 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 01:04:17.360932 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 01:04:17.360932 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 01:04:17.360932 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 01:04:17.360932 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 01:04:17.360932 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 01:04:17.360932 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 01:04:17.360932 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 01:04:17.360932 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc9ceee0-65b5-48be-8dcc-7ec2a992f72d could not be found. Aug 26 01:04:17.360932 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:04:17.360932 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:04:17.360932 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:04:17.360932 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:04:17.360932 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:04:17.360932 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:04:17.360932 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 01:04:17.360932 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 01:04:17.360932 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc9ceee0-65b5-48be-8dcc-7ec2a992f72d could not be found. Aug 26 01:04:17.360932 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:04:17.362588 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-5a888adf-145c-47f2-aaaa-05de1c4bd594 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Returning 404 to user: Instance cc9ceee0-65b5-48be-8dcc-7ec2a992f72d could not be found. {{(pid=127565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 01:04:17.362588 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-5a888adf-145c-47f2-aaaa-05de1c4bd594 tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d" status: 404 len: 111 microversion: 2.1 time: 0.029701 Aug 26 01:04:17.362588 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 497/999] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:04:17 2022] GET /compute/v2.1/servers/cc9ceee0-65b5-48be-8dcc-7ec2a992f72d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 01:04:18.882978 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-41765459-9d53-42ac-8f28-12348a22824f tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] Calling method '.version_select at 0x7f8a9662c3a0>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:04:18.999333 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-41765459-9d53-42ac-8f28-12348a22824f tempest-TestVolumeBootPattern-2142040423 tempest-TestVolumeBootPattern-2142040423-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1867992654" status: 202 len: 0 microversion: 2.1 time: 0.120133 Aug 26 01:04:18.999888 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 503/1000] 10.222.0.59 () {58 vars in 1263 bytes} [Fri Aug 26 01:04:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1867992654 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 01:04:20.221347 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-688bf81a-ac8f-4a99-9f06-e366fca14d05 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "447e8991-d58c-450d-90dc-9eeaaf05a581"}} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:04:20.224000 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-688bf81a-ac8f-4a99-9f06-e366fca14d05 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: e5344f30-5e79-4f69-a954-d080b6b9f7ed] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:04:20.231327 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-688bf81a-ac8f-4a99-9f06-e366fca14d05 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:20.231811 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-688bf81a-ac8f-4a99-9f06-e366fca14d05 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:20.232248 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-688bf81a-ac8f-4a99-9f06-e366fca14d05 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:20.232971 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-688bf81a-ac8f-4a99-9f06-e366fca14d05 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:20.233423 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-688bf81a-ac8f-4a99-9f06-e366fca14d05 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:20.233843 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-688bf81a-ac8f-4a99-9f06-e366fca14d05 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:20.316500 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.wsgi [None req-688bf81a-ac8f-4a99-9f06-e366fca14d05 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] HTTP exception thrown: Invalid volume: volume 447e8991-d58c-450d-90dc-9eeaaf05a581 is already attached to instances: e5344f30-5e79-4f69-a954-d080b6b9f7ed Aug 26 01:04:20.318069 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-688bf81a-ac8f-4a99-9f06-e366fca14d05 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Request method failure captured: Aug 26 01:04:20.318069 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: request: POST /compute/v2.1/servers/e5344f30-5e79-4f69-a954-d080b6b9f7ed/os-volume_attachments HTTP/1.1 Aug 26 01:04:20.318069 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Accept: application/json Aug 26 01:04:20.318069 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Accept-Encoding: identity Aug 26 01:04:20.318069 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Connection: close Aug 26 01:04:20.318069 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Content-Length: 74 Aug 26 01:04:20.318069 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Content-Type: application/json Aug 26 01:04:20.318069 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Host: 10.222.0.59 Aug 26 01:04:20.318069 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Openstack-System-Scope: None Aug 26 01:04:20.318069 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: User-Agent: python-urllib3/1.26.11 Aug 26 01:04:20.318069 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Auth-Token: gAAAAABjCBtKv7Ptmn6ODyXcqDwiO_uQzh6mqyqflGy1xdbBhbXPxieO4RSPPFbB4mQUaGf6pIM59uQGaWkpT_lu6RdlUkkLPi08g2IwRrKssv3K5sM8xJTV55LE3mg5hFUUhkTXeZla8aTh4ipX4VYHFhrTqhydw3qJT6H_hFgb5jrawb0wsSk Aug 26 01:04:20.318069 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Domain-Id: None Aug 26 01:04:20.318069 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Domain-Name: None Aug 26 01:04:20.318069 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Identity-Status: Confirmed Aug 26 01:04:20.318069 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Is-Admin-Project: True Aug 26 01:04:20.318069 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Domain-Id: default Aug 26 01:04:20.318069 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Domain-Name: Default Aug 26 01:04:20.318069 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Id: 03b021c415a147e08dbfede2ddc8cc27 Aug 26 01:04:20.318069 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Name: tempest-AttachVolumeNegativeTest-1692640927 Aug 26 01:04:20.318069 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Role: reader,member Aug 26 01:04:20.318069 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Roles: reader,member Aug 26 01:04:20.319859 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_03b021c415a147e08dbfede2ddc8cc27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/03b021c415a147e08dbfede2ddc8cc27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/03b021c415a147e08dbfede2ddc8cc27"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/03b021c415a147e08dbfede2ddc8cc27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 01:04:20.319859 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant: tempest-AttachVolumeNegativeTest-1692640927 Aug 26 01:04:20.319859 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant-Id: 03b021c415a147e08dbfede2ddc8cc27 Aug 26 01:04:20.319859 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1692640927 Aug 26 01:04:20.319859 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User: tempest-AttachVolumeNegativeTest-1692640927-project Aug 26 01:04:20.319859 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Domain-Id: default Aug 26 01:04:20.319859 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Domain-Name: Default Aug 26 01:04:20.319859 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Id: 38047508b7d44f05af7116a15ba7e319 Aug 26 01:04:20.319859 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Name: tempest-AttachVolumeNegativeTest-1692640927-project Aug 26 01:04:20.319859 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Aug 26 01:04:20.319859 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: {"volumeAttachment": {"volumeId": "447e8991-d58c-450d-90dc-9eeaaf05a581"}} Aug 26 01:04:20.319859 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: method: > Aug 26 01:04:20.321047 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: exception: Invalid volume: volume 447e8991-d58c-450d-90dc-9eeaaf05a581 is already attached to instances: e5344f30-5e79-4f69-a954-d080b6b9f7ed Aug 26 01:04:20.321047 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: action_args: {'server_id': 'e5344f30-5e79-4f69-a954-d080b6b9f7ed', 'body': {'volumeAttachment': {'volumeId': '447e8991-d58c-450d-90dc-9eeaaf05a581'}}} Aug 26 01:04:20.321047 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 01:04:20.321047 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:04:20.321047 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 26 01:04:20.321047 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 26 01:04:20.321047 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 26 01:04:20.321047 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 26 01:04:20.321047 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 26 01:04:20.321047 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 26 01:04:20.321047 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 26 01:04:20.321047 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 26 01:04:20.321047 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 26 01:04:20.321047 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 26 01:04:20.321047 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 447e8991-d58c-450d-90dc-9eeaaf05a581 is already attached to instances: e5344f30-5e79-4f69-a954-d080b6b9f7ed Aug 26 01:04:20.321047 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:04:20.321047 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:04:20.321047 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:04:20.321047 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:04:20.322583 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:04:20.322583 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:04:20.322583 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 01:04:20.322583 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 01:04:20.322583 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 01:04:20.322583 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 01:04:20.322583 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 01:04:20.322583 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 01:04:20.322583 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 01:04:20.322583 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 01:04:20.322583 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 01:04:20.322583 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 01:04:20.322583 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 26 01:04:20.322583 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 26 01:04:20.322583 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 447e8991-d58c-450d-90dc-9eeaaf05a581 is already attached to instances: e5344f30-5e79-4f69-a954-d080b6b9f7ed Aug 26 01:04:20.322583 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:04:20.322583 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:04:20.322583 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:04:20.322583 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:04:20.322583 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:04:20.324210 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:04:20.324210 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 01:04:20.324210 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 01:04:20.324210 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 447e8991-d58c-450d-90dc-9eeaaf05a581 is already attached to instances: e5344f30-5e79-4f69-a954-d080b6b9f7ed Aug 26 01:04:20.324210 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:04:20.324210 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-688bf81a-ac8f-4a99-9f06-e366fca14d05 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Returning 400 to user: Invalid volume: volume 447e8991-d58c-450d-90dc-9eeaaf05a581 is already attached to instances: e5344f30-5e79-4f69-a954-d080b6b9f7ed {{(pid=127565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 01:04:20.324210 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-688bf81a-ac8f-4a99-9f06-e366fca14d05 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "POST /compute/v2.1/servers/e5344f30-5e79-4f69-a954-d080b6b9f7ed/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102248 Aug 26 01:04:20.324210 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 498/1001] 10.222.0.59 () {60 vars in 1323 bytes} [Fri Aug 26 01:04:20 2022] POST /compute/v2.1/servers/e5344f30-5e79-4f69-a954-d080b6b9f7ed/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 26 01:04:20.383061 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-093fa765-1386-460c-821e-9fa7d3f0d32a tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:04:20.383613 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-093fa765-1386-460c-821e-9fa7d3f0d32a tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: e5344f30-5e79-4f69-a954-d080b6b9f7ed] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:04:20.390154 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-093fa765-1386-460c-821e-9fa7d3f0d32a tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:20.391152 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-093fa765-1386-460c-821e-9fa7d3f0d32a tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:20.391788 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-093fa765-1386-460c-821e-9fa7d3f0d32a tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:20.392490 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-093fa765-1386-460c-821e-9fa7d3f0d32a tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:20.392944 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-093fa765-1386-460c-821e-9fa7d3f0d32a tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:20.393360 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-093fa765-1386-460c-821e-9fa7d3f0d32a tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:20.477049 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.objects.instance [None req-093fa765-1386-460c-821e-9fa7d3f0d32a tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lazy-loading 'services' on Instance uuid e5344f30-5e79-4f69-a954-d080b6b9f7ed {{(pid=127564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 01:04:20.693110 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-093fa765-1386-460c-821e-9fa7d3f0d32a tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "DELETE /compute/v2.1/servers/e5344f30-5e79-4f69-a954-d080b6b9f7ed/os-volume_attachments/447e8991-d58c-450d-90dc-9eeaaf05a581" status: 202 len: 0 microversion: 2.1 time: 0.311965 Aug 26 01:04:20.695430 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 504/1002] 10.222.0.59 () {58 vars in 1416 bytes} [Fri Aug 26 01:04:20 2022] DELETE /compute/v2.1/servers/e5344f30-5e79-4f69-a954-d080b6b9f7ed/os-volume_attachments/447e8991-d58c-450d-90dc-9eeaaf05a581 => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 01:04:20.703456 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-6bf689d5-55aa-4c3c-8ce8-7fef70d11323 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:04:20.706028 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-6bf689d5-55aa-4c3c-8ce8-7fef70d11323 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: e5344f30-5e79-4f69-a954-d080b6b9f7ed] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:04:20.715985 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6bf689d5-55aa-4c3c-8ce8-7fef70d11323 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:20.719575 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6bf689d5-55aa-4c3c-8ce8-7fef70d11323 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:20.723542 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6bf689d5-55aa-4c3c-8ce8-7fef70d11323 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:20.737514 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6bf689d5-55aa-4c3c-8ce8-7fef70d11323 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:20.738341 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6bf689d5-55aa-4c3c-8ce8-7fef70d11323 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:20.738963 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6bf689d5-55aa-4c3c-8ce8-7fef70d11323 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:20.776675 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-6bf689d5-55aa-4c3c-8ce8-7fef70d11323 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/e5344f30-5e79-4f69-a954-d080b6b9f7ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077517 Aug 26 01:04:20.777170 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 499/1003] 10.222.0.59 () {58 vars in 1302 bytes} [Fri Aug 26 01:04:20 2022] GET /compute/v2.1/servers/e5344f30-5e79-4f69-a954-d080b6b9f7ed/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:04:21.791187 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-29b05a47-47cf-4c41-8316-365ad4774445 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:04:21.793027 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-29b05a47-47cf-4c41-8316-365ad4774445 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: e5344f30-5e79-4f69-a954-d080b6b9f7ed] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:04:21.800282 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-29b05a47-47cf-4c41-8316-365ad4774445 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:21.800454 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-29b05a47-47cf-4c41-8316-365ad4774445 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:21.801189 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-29b05a47-47cf-4c41-8316-365ad4774445 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:21.802099 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-29b05a47-47cf-4c41-8316-365ad4774445 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:21.802555 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-29b05a47-47cf-4c41-8316-365ad4774445 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:21.802986 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-29b05a47-47cf-4c41-8316-365ad4774445 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:21.837472 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-29b05a47-47cf-4c41-8316-365ad4774445 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/e5344f30-5e79-4f69-a954-d080b6b9f7ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052085 Aug 26 01:04:21.838044 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 505/1004] 10.222.0.59 () {58 vars in 1302 bytes} [Fri Aug 26 01:04:21 2022] GET /compute/v2.1/servers/e5344f30-5e79-4f69-a954-d080b6b9f7ed/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:04:22.849057 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-3580faac-0374-4d3a-b5a1-40871dd522e8 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:04:22.851258 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-3580faac-0374-4d3a-b5a1-40871dd522e8 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: e5344f30-5e79-4f69-a954-d080b6b9f7ed] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:04:22.857657 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3580faac-0374-4d3a-b5a1-40871dd522e8 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:22.858134 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3580faac-0374-4d3a-b5a1-40871dd522e8 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:22.858567 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3580faac-0374-4d3a-b5a1-40871dd522e8 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:22.859747 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3580faac-0374-4d3a-b5a1-40871dd522e8 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:22.860195 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3580faac-0374-4d3a-b5a1-40871dd522e8 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:22.860667 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3580faac-0374-4d3a-b5a1-40871dd522e8 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:22.889651 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-3580faac-0374-4d3a-b5a1-40871dd522e8 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/e5344f30-5e79-4f69-a954-d080b6b9f7ed/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044500 Aug 26 01:04:22.890200 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 500/1005] 10.222.0.59 () {58 vars in 1302 bytes} [Fri Aug 26 01:04:22 2022] GET /compute/v2.1/servers/e5344f30-5e79-4f69-a954-d080b6b9f7ed/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 01:04:22.968202 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-a95be702-7a22-4970-8512-285829d82084 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:04:22.968810 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-a95be702-7a22-4970-8512-285829d82084 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: e5344f30-5e79-4f69-a954-d080b6b9f7ed] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:04:22.975468 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a95be702-7a22-4970-8512-285829d82084 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:22.975958 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a95be702-7a22-4970-8512-285829d82084 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:22.976397 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a95be702-7a22-4970-8512-285829d82084 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:22.977129 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a95be702-7a22-4970-8512-285829d82084 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:22.977578 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a95be702-7a22-4970-8512-285829d82084 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:22.978004 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-a95be702-7a22-4970-8512-285829d82084 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:23.004973 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-a95be702-7a22-4970-8512-285829d82084 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: e5344f30-5e79-4f69-a954-d080b6b9f7ed] Going to try to terminate instance {{(pid=127564) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 01:04:23.039533 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:04:23.346012 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-a95be702-7a22-4970-8512-285829d82084 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "DELETE /compute/v2.1/servers/e5344f30-5e79-4f69-a954-d080b6b9f7ed" status: 204 len: 0 microversion: 2.1 time: 0.381502 Aug 26 01:04:23.346900 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 506/1006] 10.222.0.59 () {58 vars in 1239 bytes} [Fri Aug 26 01:04:22 2022] DELETE /compute/v2.1/servers/e5344f30-5e79-4f69-a954-d080b6b9f7ed => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 01:04:23.354980 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-b923cf43-4c19-4324-aabc-aaf59012338f tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:04:23.355597 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-b923cf43-4c19-4324-aabc-aaf59012338f tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: e5344f30-5e79-4f69-a954-d080b6b9f7ed] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:04:23.362197 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b923cf43-4c19-4324-aabc-aaf59012338f tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:23.362705 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b923cf43-4c19-4324-aabc-aaf59012338f tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:23.363146 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b923cf43-4c19-4324-aabc-aaf59012338f tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:23.363838 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b923cf43-4c19-4324-aabc-aaf59012338f tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:23.364290 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b923cf43-4c19-4324-aabc-aaf59012338f tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:23.364754 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-b923cf43-4c19-4324-aabc-aaf59012338f tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:23.504905 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-b923cf43-4c19-4324-aabc-aaf59012338f tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38047508b7d44f05af7116a15ba7e319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b021c415a147e08dbfede2ddc8cc27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:04:23.508640 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-b923cf43-4c19-4324-aabc-aaf59012338f tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/e5344f30-5e79-4f69-a954-d080b6b9f7ed" status: 200 len: 1684 microversion: 2.1 time: 0.157486 Aug 26 01:04:23.509207 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 501/1007] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:04:23 2022] GET /compute/v2.1/servers/e5344f30-5e79-4f69-a954-d080b6b9f7ed => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:04:24.530909 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-e51387ae-08c8-4d9c-8878-1916c42f4160 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:04:24.532080 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-e51387ae-08c8-4d9c-8878-1916c42f4160 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: e5344f30-5e79-4f69-a954-d080b6b9f7ed] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:04:24.539592 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e51387ae-08c8-4d9c-8878-1916c42f4160 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:24.540173 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e51387ae-08c8-4d9c-8878-1916c42f4160 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:24.540712 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e51387ae-08c8-4d9c-8878-1916c42f4160 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:24.541941 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e51387ae-08c8-4d9c-8878-1916c42f4160 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:24.542565 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e51387ae-08c8-4d9c-8878-1916c42f4160 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:24.542993 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e51387ae-08c8-4d9c-8878-1916c42f4160 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:24.675240 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-e51387ae-08c8-4d9c-8878-1916c42f4160 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38047508b7d44f05af7116a15ba7e319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b021c415a147e08dbfede2ddc8cc27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:04:24.683183 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-e51387ae-08c8-4d9c-8878-1916c42f4160 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/e5344f30-5e79-4f69-a954-d080b6b9f7ed" status: 200 len: 1684 microversion: 2.1 time: 0.156469 Aug 26 01:04:24.684002 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 507/1008] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:04:24 2022] GET /compute/v2.1/servers/e5344f30-5e79-4f69-a954-d080b6b9f7ed => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:04:25.797969 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-3786a41f-0ba0-4dea-98f8-fc2f6b61a3b2 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:04:25.797969 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-3786a41f-0ba0-4dea-98f8-fc2f6b61a3b2 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: e5344f30-5e79-4f69-a954-d080b6b9f7ed] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:04:25.797969 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3786a41f-0ba0-4dea-98f8-fc2f6b61a3b2 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:25.797969 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3786a41f-0ba0-4dea-98f8-fc2f6b61a3b2 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:25.799371 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3786a41f-0ba0-4dea-98f8-fc2f6b61a3b2 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:25.799371 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3786a41f-0ba0-4dea-98f8-fc2f6b61a3b2 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:25.799371 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3786a41f-0ba0-4dea-98f8-fc2f6b61a3b2 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:25.799371 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3786a41f-0ba0-4dea-98f8-fc2f6b61a3b2 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:25.892204 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-3786a41f-0ba0-4dea-98f8-fc2f6b61a3b2 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38047508b7d44f05af7116a15ba7e319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b021c415a147e08dbfede2ddc8cc27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:04:25.900099 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-3786a41f-0ba0-4dea-98f8-fc2f6b61a3b2 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/e5344f30-5e79-4f69-a954-d080b6b9f7ed" status: 200 len: 1684 microversion: 2.1 time: 0.198323 Aug 26 01:04:25.914737 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 502/1009] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:04:25 2022] GET /compute/v2.1/servers/e5344f30-5e79-4f69-a954-d080b6b9f7ed => generated 1684 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 01:04:26.512844 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [req-37584735-5565-4b4d-bd7b-fdf35560aa9b req-7be8e14c-f4b9-4b93-bff4-cfc72536abf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5344f30-5e79-4f69-a954-d080b6b9f7ed", "name": "network-vif-deleted", "tag": "bd537a03-4210-4576-9d92-e96d9f5b3e29"}]} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:04:26.538718 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-37584735-5565-4b4d-bd7b-fdf35560aa9b req-7be8e14c-f4b9-4b93-bff4-cfc72536abf6 service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:26.538718 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-37584735-5565-4b4d-bd7b-fdf35560aa9b req-7be8e14c-f4b9-4b93-bff4-cfc72536abf6 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:26.541859 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-37584735-5565-4b4d-bd7b-fdf35560aa9b req-7be8e14c-f4b9-4b93-bff4-cfc72536abf6 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:26.557919 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.compute.server_external_events [req-37584735-5565-4b4d-bd7b-fdf35560aa9b req-7be8e14c-f4b9-4b93-bff4-cfc72536abf6 service nova] Creating event network-vif-deleted:bd537a03-4210-4576-9d92-e96d9f5b3e29 for instance e5344f30-5e79-4f69-a954-d080b6b9f7ed on hv-cinder-83538 Aug 26 01:04:26.564360 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [req-37584735-5565-4b4d-bd7b-fdf35560aa9b req-7be8e14c-f4b9-4b93-bff4-cfc72536abf6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129498 Aug 26 01:04:26.569696 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 508/1010] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 01:04:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:04:26.921430 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-3fe374f4-6816-47a0-8b36-3c787c67676a tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:04:26.927057 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-3fe374f4-6816-47a0-8b36-3c787c67676a tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: e5344f30-5e79-4f69-a954-d080b6b9f7ed] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:04:26.936984 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3fe374f4-6816-47a0-8b36-3c787c67676a tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:26.938043 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3fe374f4-6816-47a0-8b36-3c787c67676a tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:26.938773 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3fe374f4-6816-47a0-8b36-3c787c67676a tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:26.939515 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3fe374f4-6816-47a0-8b36-3c787c67676a tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:26.939974 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3fe374f4-6816-47a0-8b36-3c787c67676a tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:26.942903 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3fe374f4-6816-47a0-8b36-3c787c67676a tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:26.983006 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3fe374f4-6816-47a0-8b36-3c787c67676a tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:26.983489 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3fe374f4-6816-47a0-8b36-3c787c67676a tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:26.983975 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3fe374f4-6816-47a0-8b36-3c787c67676a tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:26.984409 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.objects.instance [None req-3fe374f4-6816-47a0-8b36-3c787c67676a tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lazy-loading 'fault' on Instance uuid e5344f30-5e79-4f69-a954-d080b6b9f7ed {{(pid=127565) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 01:04:27.052229 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-3fe374f4-6816-47a0-8b36-3c787c67676a tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38047508b7d44f05af7116a15ba7e319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b021c415a147e08dbfede2ddc8cc27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:04:27.052229 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-3fe374f4-6816-47a0-8b36-3c787c67676a tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/e5344f30-5e79-4f69-a954-d080b6b9f7ed" status: 200 len: 1332 microversion: 2.1 time: 0.127224 Aug 26 01:04:27.052229 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 503/1011] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:04:26 2022] GET /compute/v2.1/servers/e5344f30-5e79-4f69-a954-d080b6b9f7ed => generated 1332 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:04:28.067435 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-d216b11a-25cf-43a0-bf9e-8a54b205828d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:04:28.068164 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-d216b11a-25cf-43a0-bf9e-8a54b205828d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: e5344f30-5e79-4f69-a954-d080b6b9f7ed] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:04:28.074357 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-d216b11a-25cf-43a0-bf9e-8a54b205828d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:28.074837 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-d216b11a-25cf-43a0-bf9e-8a54b205828d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:28.075391 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-d216b11a-25cf-43a0-bf9e-8a54b205828d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:28.076099 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-d216b11a-25cf-43a0-bf9e-8a54b205828d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:28.076572 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-d216b11a-25cf-43a0-bf9e-8a54b205828d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:28.077000 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-d216b11a-25cf-43a0-bf9e-8a54b205828d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:28.090405 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.wsgi [None req-d216b11a-25cf-43a0-bf9e-8a54b205828d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] HTTP exception thrown: Instance e5344f30-5e79-4f69-a954-d080b6b9f7ed could not be found. Aug 26 01:04:28.092024 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-d216b11a-25cf-43a0-bf9e-8a54b205828d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Request method failure captured: Aug 26 01:04:28.092024 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: request: GET /compute/v2.1/servers/e5344f30-5e79-4f69-a954-d080b6b9f7ed HTTP/1.1 Aug 26 01:04:28.092024 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Accept: application/json Aug 26 01:04:28.092024 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Accept-Encoding: identity Aug 26 01:04:28.092024 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Connection: close Aug 26 01:04:28.092024 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Content-Length: 0 Aug 26 01:04:28.092024 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Content-Type: application/json Aug 26 01:04:28.092024 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Host: 10.222.0.59 Aug 26 01:04:28.092024 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Openstack-System-Scope: None Aug 26 01:04:28.092024 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: User-Agent: python-urllib3/1.26.11 Aug 26 01:04:28.092024 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Auth-Token: gAAAAABjCBtKv7Ptmn6ODyXcqDwiO_uQzh6mqyqflGy1xdbBhbXPxieO4RSPPFbB4mQUaGf6pIM59uQGaWkpT_lu6RdlUkkLPi08g2IwRrKssv3K5sM8xJTV55LE3mg5hFUUhkTXeZla8aTh4ipX4VYHFhrTqhydw3qJT6H_hFgb5jrawb0wsSk Aug 26 01:04:28.092024 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Domain-Id: None Aug 26 01:04:28.092024 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Domain-Name: None Aug 26 01:04:28.092024 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Identity-Status: Confirmed Aug 26 01:04:28.092024 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Is-Admin-Project: True Aug 26 01:04:28.092024 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Domain-Id: default Aug 26 01:04:28.092024 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Domain-Name: Default Aug 26 01:04:28.092024 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Id: 03b021c415a147e08dbfede2ddc8cc27 Aug 26 01:04:28.092024 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Name: tempest-AttachVolumeNegativeTest-1692640927 Aug 26 01:04:28.092024 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Role: reader,member Aug 26 01:04:28.092024 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Roles: reader,member Aug 26 01:04:28.094027 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_03b021c415a147e08dbfede2ddc8cc27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/03b021c415a147e08dbfede2ddc8cc27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/03b021c415a147e08dbfede2ddc8cc27"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/03b021c415a147e08dbfede2ddc8cc27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 01:04:28.094027 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant: tempest-AttachVolumeNegativeTest-1692640927 Aug 26 01:04:28.094027 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant-Id: 03b021c415a147e08dbfede2ddc8cc27 Aug 26 01:04:28.094027 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1692640927 Aug 26 01:04:28.094027 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User: tempest-AttachVolumeNegativeTest-1692640927-project Aug 26 01:04:28.094027 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Domain-Id: default Aug 26 01:04:28.094027 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Domain-Name: Default Aug 26 01:04:28.094027 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Id: 38047508b7d44f05af7116a15ba7e319 Aug 26 01:04:28.094027 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Name: tempest-AttachVolumeNegativeTest-1692640927-project Aug 26 01:04:28.094027 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: method: > Aug 26 01:04:28.094027 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: exception: Instance e5344f30-5e79-4f69-a954-d080b6b9f7ed could not be found. Aug 26 01:04:28.094027 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: action_args: {'id': 'e5344f30-5e79-4f69-a954-d080b6b9f7ed'} Aug 26 01:04:28.095033 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 01:04:28.095033 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:04:28.095033 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 01:04:28.095033 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 01:04:28.095033 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 01:04:28.095033 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 01:04:28.095033 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 01:04:28.095033 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 01:04:28.095033 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 01:04:28.095033 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 01:04:28.095033 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5344f30-5e79-4f69-a954-d080b6b9f7ed could not be found. Aug 26 01:04:28.095033 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:04:28.095033 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:04:28.095033 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:04:28.095033 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:04:28.095033 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:04:28.095033 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:04:28.095033 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 01:04:28.095033 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 01:04:28.095033 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 01:04:28.096752 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 01:04:28.096752 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 01:04:28.096752 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 01:04:28.096752 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 01:04:28.096752 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 01:04:28.096752 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 01:04:28.096752 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 01:04:28.096752 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5344f30-5e79-4f69-a954-d080b6b9f7ed could not be found. Aug 26 01:04:28.096752 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:04:28.096752 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:04:28.096752 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:04:28.096752 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:04:28.096752 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:04:28.096752 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:04:28.096752 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 01:04:28.096752 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 01:04:28.096752 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5344f30-5e79-4f69-a954-d080b6b9f7ed could not be found. Aug 26 01:04:28.096752 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:04:28.098248 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-d216b11a-25cf-43a0-bf9e-8a54b205828d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Returning 404 to user: Instance e5344f30-5e79-4f69-a954-d080b6b9f7ed could not be found. {{(pid=127564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 01:04:28.098248 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-d216b11a-25cf-43a0-bf9e-8a54b205828d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/e5344f30-5e79-4f69-a954-d080b6b9f7ed" status: 404 len: 111 microversion: 2.1 time: 0.031624 Aug 26 01:04:28.098248 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 509/1012] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:04:28 2022] GET /compute/v2.1/servers/e5344f30-5e79-4f69-a954-d080b6b9f7ed => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 01:04:28.102683 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-350ece3c-f350-4b17-ab3b-cae1434b40cc tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '.version_select at 0x7f8a92d56670>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:04:28.193190 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-350ece3c-f350-4b17-ab3b-cae1434b40cc tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1648508237" status: 202 len: 0 microversion: 2.1 time: 0.094209 Aug 26 01:04:28.193774 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 504/1013] 10.222.0.59 () {58 vars in 1221 bytes} [Fri Aug 26 01:04:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1648508237 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 01:04:29.035011 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-89fb5adf-d084-408f-815e-3b3f1d9ae236 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Action: 'create', calling method: .version_select at 0x7f8a96636dc0>, body: {"keypair": {"name": "tempest-keypair-413191101", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDNzmJXwHyF3bVj323NzW0ZMLTx0ktQS1fEDTvgmHfMRtr2pWupayBZjiU8rS4DLHiBpQtXN6MWHNv9wJcKt1S8WEuulyb2PcSHbsQ6VZWHpL8ngyN6uBMMA8To3RDlXUg=="}} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:04:29.052977 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.quota [None req-89fb5adf-d084-408f-815e-3b3f1d9ae236 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Getting quotas for project 03b021c415a147e08dbfede2ddc8cc27. Resources: {'key_pairs'} {{(pid=127564) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 01:04:29.057181 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.quota [None req-89fb5adf-d084-408f-815e-3b3f1d9ae236 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Getting quotas for user 38047508b7d44f05af7116a15ba7e319 and project 03b021c415a147e08dbfede2ddc8cc27. Resources: {'key_pairs'} {{(pid=127564) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 01:04:29.158833 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-89fb5adf-d084-408f-815e-3b3f1d9ae236 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.128508 Aug 26 01:04:29.159517 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 510/1014] 10.222.0.59 () {60 vars in 1159 bytes} [Fri Aug 26 01:04:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:04:31.470967 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-57ee5533-003a-41fc-8ab4-71dc193541e1 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-671966656", "imageRef": "ef60327f-6e0c-4f85-8db9-6f6e8968fe9c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "de5adc9b-87c3-4a41-9cca-c473a399648a"}], "security_groups": [{"name": "tempest-securitygroup--1015791282"}], "key_name": "tempest-keypair-413191101", "user_data": "}} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:04:31.572967 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.network.neutron [None req-57ee5533-003a-41fc-8ab4-71dc193541e1 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] validate_networks() for [('de5adc9b-87c3-4a41-9cca-c473a399648a', None, None, None, None, None)] {{(pid=127565) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 01:04:32.038705 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.virt.hardware [None req-57ee5533-003a-41fc-8ab4-71dc193541e1 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Flavor limits 0:0:0 {{(pid=127565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 01:04:32.039131 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.virt.hardware [None req-57ee5533-003a-41fc-8ab4-71dc193541e1 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Image limits 0:0:0 {{(pid=127565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 01:04:32.039606 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.virt.hardware [None req-57ee5533-003a-41fc-8ab4-71dc193541e1 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Flavor pref 0:0:0 {{(pid=127565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 01:04:32.040016 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.virt.hardware [None req-57ee5533-003a-41fc-8ab4-71dc193541e1 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Image pref 0:0:0 {{(pid=127565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 01:04:32.040425 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.virt.hardware [None req-57ee5533-003a-41fc-8ab4-71dc193541e1 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 01:04:32.049581 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-57ee5533-003a-41fc-8ab4-71dc193541e1 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:32.050059 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-57ee5533-003a-41fc-8ab4-71dc193541e1 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:32.050498 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-57ee5533-003a-41fc-8ab4-71dc193541e1 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:32.051219 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-57ee5533-003a-41fc-8ab4-71dc193541e1 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:32.051659 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-57ee5533-003a-41fc-8ab4-71dc193541e1 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:32.052131 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-57ee5533-003a-41fc-8ab4-71dc193541e1 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:32.068930 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.quota [None req-57ee5533-003a-41fc-8ab4-71dc193541e1 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Getting quotas for project 03b021c415a147e08dbfede2ddc8cc27. Resources: {'instances', 'ram', 'cores'} {{(pid=127565) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 01:04:32.073020 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.quota [None req-57ee5533-003a-41fc-8ab4-71dc193541e1 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Getting quotas for user 38047508b7d44f05af7116a15ba7e319 and project 03b021c415a147e08dbfede2ddc8cc27. Resources: {'instances', 'ram', 'cores'} {{(pid=127565) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 01:04:32.084272 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-57ee5533-003a-41fc-8ab4-71dc193541e1 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Going to run 1 instances... {{(pid=127565) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 01:04:32.086554 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-57ee5533-003a-41fc-8ab4-71dc193541e1 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: 0d30e6dd-58a1-41b7-a675-5bfdb19e7415] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ef60327f-6e0c-4f85-8db9-6f6e8968fe9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127565) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 01:04:32.222920 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-57ee5533-003a-41fc-8ab4-71dc193541e1 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.757370 Aug 26 01:04:32.223556 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 505/1015] 10.222.0.59 () {60 vars in 1147 bytes} [Fri Aug 26 01:04:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 01:04:32.234753 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-c1dfcabc-bba3-48d2-b3bc-93b47e06b991 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:04:32.235440 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-c1dfcabc-bba3-48d2-b3bc-93b47e06b991 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: 0d30e6dd-58a1-41b7-a675-5bfdb19e7415] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:04:32.291375 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-c1dfcabc-bba3-48d2-b3bc-93b47e06b991 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38047508b7d44f05af7116a15ba7e319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b021c415a147e08dbfede2ddc8cc27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:04:32.298827 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-c1dfcabc-bba3-48d2-b3bc-93b47e06b991 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/0d30e6dd-58a1-41b7-a675-5bfdb19e7415" status: 200 len: 1240 microversion: 2.1 time: 0.068339 Aug 26 01:04:32.299388 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 511/1016] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:04:32 2022] GET /compute/v2.1/servers/0d30e6dd-58a1-41b7-a675-5bfdb19e7415 => generated 1240 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:04:33.319797 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-a736affe-b7cf-4b66-af32-ddfc017772b6 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:04:33.320408 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-a736affe-b7cf-4b66-af32-ddfc017772b6 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: 0d30e6dd-58a1-41b7-a675-5bfdb19e7415] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:04:33.327134 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a736affe-b7cf-4b66-af32-ddfc017772b6 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:33.327619 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a736affe-b7cf-4b66-af32-ddfc017772b6 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:33.328054 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a736affe-b7cf-4b66-af32-ddfc017772b6 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:33.329277 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a736affe-b7cf-4b66-af32-ddfc017772b6 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:33.329736 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a736affe-b7cf-4b66-af32-ddfc017772b6 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:33.330159 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a736affe-b7cf-4b66-af32-ddfc017772b6 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:33.334185 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:04:33.389410 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-a736affe-b7cf-4b66-af32-ddfc017772b6 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38047508b7d44f05af7116a15ba7e319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b021c415a147e08dbfede2ddc8cc27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:04:33.397413 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-a736affe-b7cf-4b66-af32-ddfc017772b6 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/0d30e6dd-58a1-41b7-a675-5bfdb19e7415" status: 200 len: 1244 microversion: 2.1 time: 0.082014 Aug 26 01:04:33.397972 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 506/1017] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:04:33 2022] GET /compute/v2.1/servers/0d30e6dd-58a1-41b7-a675-5bfdb19e7415 => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:04:34.418687 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-1e29dfb2-e41d-4dd6-9fdf-80a407e58805 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:04:34.419297 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-1e29dfb2-e41d-4dd6-9fdf-80a407e58805 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: 0d30e6dd-58a1-41b7-a675-5bfdb19e7415] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:04:34.421760 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:04:34.427179 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1e29dfb2-e41d-4dd6-9fdf-80a407e58805 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:34.427669 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1e29dfb2-e41d-4dd6-9fdf-80a407e58805 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:34.428103 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1e29dfb2-e41d-4dd6-9fdf-80a407e58805 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:34.428823 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1e29dfb2-e41d-4dd6-9fdf-80a407e58805 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:34.429278 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1e29dfb2-e41d-4dd6-9fdf-80a407e58805 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:34.429699 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1e29dfb2-e41d-4dd6-9fdf-80a407e58805 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:34.497784 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-1e29dfb2-e41d-4dd6-9fdf-80a407e58805 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38047508b7d44f05af7116a15ba7e319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b021c415a147e08dbfede2ddc8cc27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:04:34.505536 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-1e29dfb2-e41d-4dd6-9fdf-80a407e58805 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/0d30e6dd-58a1-41b7-a675-5bfdb19e7415" status: 200 len: 1292 microversion: 2.1 time: 0.090703 Aug 26 01:04:34.506097 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 512/1018] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:04:34 2022] GET /compute/v2.1/servers/0d30e6dd-58a1-41b7-a675-5bfdb19e7415 => generated 1292 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:04:35.526845 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-e1fbba4b-c05c-4e3f-ba93-20a8ae29627e tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:04:35.532791 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-e1fbba4b-c05c-4e3f-ba93-20a8ae29627e tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: 0d30e6dd-58a1-41b7-a675-5bfdb19e7415] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:04:35.532791 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:04:35.535078 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e1fbba4b-c05c-4e3f-ba93-20a8ae29627e tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:35.535563 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e1fbba4b-c05c-4e3f-ba93-20a8ae29627e tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:35.536002 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e1fbba4b-c05c-4e3f-ba93-20a8ae29627e tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:35.536730 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e1fbba4b-c05c-4e3f-ba93-20a8ae29627e tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:35.537457 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e1fbba4b-c05c-4e3f-ba93-20a8ae29627e tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:35.537878 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e1fbba4b-c05c-4e3f-ba93-20a8ae29627e tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:35.676118 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-e1fbba4b-c05c-4e3f-ba93-20a8ae29627e tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38047508b7d44f05af7116a15ba7e319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b021c415a147e08dbfede2ddc8cc27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:04:35.682777 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-e1fbba4b-c05c-4e3f-ba93-20a8ae29627e tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/0d30e6dd-58a1-41b7-a675-5bfdb19e7415" status: 200 len: 1366 microversion: 2.1 time: 0.160331 Aug 26 01:04:35.683653 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 507/1019] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:04:35 2022] GET /compute/v2.1/servers/0d30e6dd-58a1-41b7-a675-5bfdb19e7415 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:04:36.358859 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [req-89deaca0-4894-461c-b191-a06442388d06 req-0a1633af-59f7-445b-a699-d6fb689eca7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d30e6dd-58a1-41b7-a675-5bfdb19e7415", "tag": "99c6fe4e-f024-4025-96b6-749ad0bc652c"}]} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:04:36.369817 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-89deaca0-4894-461c-b191-a06442388d06 req-0a1633af-59f7-445b-a699-d6fb689eca7c service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:36.370298 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-89deaca0-4894-461c-b191-a06442388d06 req-0a1633af-59f7-445b-a699-d6fb689eca7c service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:36.371049 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-89deaca0-4894-461c-b191-a06442388d06 req-0a1633af-59f7-445b-a699-d6fb689eca7c service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:36.381916 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.compute.server_external_events [req-89deaca0-4894-461c-b191-a06442388d06 req-0a1633af-59f7-445b-a699-d6fb689eca7c service nova] Creating event network-changed:99c6fe4e-f024-4025-96b6-749ad0bc652c for instance 0d30e6dd-58a1-41b7-a675-5bfdb19e7415 on hv-cinder-83538 Aug 26 01:04:36.386971 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [req-89deaca0-4894-461c-b191-a06442388d06 req-0a1633af-59f7-445b-a699-d6fb689eca7c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032115 Aug 26 01:04:36.387443 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 513/1020] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 01:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 01:04:36.704178 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-95600c4c-33bf-45be-81fa-c7e72c3b2857 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:04:36.706071 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-95600c4c-33bf-45be-81fa-c7e72c3b2857 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: 0d30e6dd-58a1-41b7-a675-5bfdb19e7415] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:04:36.713535 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-95600c4c-33bf-45be-81fa-c7e72c3b2857 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:36.714008 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-95600c4c-33bf-45be-81fa-c7e72c3b2857 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:36.714440 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-95600c4c-33bf-45be-81fa-c7e72c3b2857 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:36.715168 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-95600c4c-33bf-45be-81fa-c7e72c3b2857 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:36.715592 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-95600c4c-33bf-45be-81fa-c7e72c3b2857 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:36.716008 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-95600c4c-33bf-45be-81fa-c7e72c3b2857 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:36.848136 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-95600c4c-33bf-45be-81fa-c7e72c3b2857 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38047508b7d44f05af7116a15ba7e319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b021c415a147e08dbfede2ddc8cc27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:04:36.856148 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-95600c4c-33bf-45be-81fa-c7e72c3b2857 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/0d30e6dd-58a1-41b7-a675-5bfdb19e7415" status: 200 len: 1366 microversion: 2.1 time: 0.156167 Aug 26 01:04:36.856756 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 508/1021] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:04:36 2022] GET /compute/v2.1/servers/0d30e6dd-58a1-41b7-a675-5bfdb19e7415 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:04:37.877631 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-29663946-8bd4-45bd-a1b7-59e557de56e0 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:04:37.878334 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-29663946-8bd4-45bd-a1b7-59e557de56e0 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: 0d30e6dd-58a1-41b7-a675-5bfdb19e7415] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:04:37.884544 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-29663946-8bd4-45bd-a1b7-59e557de56e0 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:37.885024 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-29663946-8bd4-45bd-a1b7-59e557de56e0 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:37.885462 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-29663946-8bd4-45bd-a1b7-59e557de56e0 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:37.886140 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-29663946-8bd4-45bd-a1b7-59e557de56e0 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:37.886591 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-29663946-8bd4-45bd-a1b7-59e557de56e0 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:37.887014 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-29663946-8bd4-45bd-a1b7-59e557de56e0 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:38.015472 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-29663946-8bd4-45bd-a1b7-59e557de56e0 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38047508b7d44f05af7116a15ba7e319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b021c415a147e08dbfede2ddc8cc27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:04:38.023786 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-29663946-8bd4-45bd-a1b7-59e557de56e0 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/0d30e6dd-58a1-41b7-a675-5bfdb19e7415" status: 200 len: 1366 microversion: 2.1 time: 0.151273 Aug 26 01:04:38.024346 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 514/1022] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:04:37 2022] GET /compute/v2.1/servers/0d30e6dd-58a1-41b7-a675-5bfdb19e7415 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 01:04:39.048194 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-e5b9e278-004b-45ce-9a42-53bc59086388 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:04:39.048921 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-e5b9e278-004b-45ce-9a42-53bc59086388 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: 0d30e6dd-58a1-41b7-a675-5bfdb19e7415] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:04:39.055494 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e5b9e278-004b-45ce-9a42-53bc59086388 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:39.055983 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e5b9e278-004b-45ce-9a42-53bc59086388 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:39.056419 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e5b9e278-004b-45ce-9a42-53bc59086388 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:39.057165 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e5b9e278-004b-45ce-9a42-53bc59086388 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:39.057617 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e5b9e278-004b-45ce-9a42-53bc59086388 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:39.058088 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e5b9e278-004b-45ce-9a42-53bc59086388 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:39.189043 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-e5b9e278-004b-45ce-9a42-53bc59086388 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38047508b7d44f05af7116a15ba7e319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b021c415a147e08dbfede2ddc8cc27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:04:39.196751 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-e5b9e278-004b-45ce-9a42-53bc59086388 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/0d30e6dd-58a1-41b7-a675-5bfdb19e7415" status: 200 len: 1366 microversion: 2.1 time: 0.152559 Aug 26 01:04:39.197313 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 509/1023] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:04:39 2022] GET /compute/v2.1/servers/0d30e6dd-58a1-41b7-a675-5bfdb19e7415 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:04:40.217623 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-41c0e440-f773-4e3e-a605-730329047c3c tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:04:40.218228 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-41c0e440-f773-4e3e-a605-730329047c3c tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: 0d30e6dd-58a1-41b7-a675-5bfdb19e7415] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:04:40.225582 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-41c0e440-f773-4e3e-a605-730329047c3c tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:40.226071 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-41c0e440-f773-4e3e-a605-730329047c3c tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:40.226513 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-41c0e440-f773-4e3e-a605-730329047c3c tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:40.227212 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-41c0e440-f773-4e3e-a605-730329047c3c tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:40.227663 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-41c0e440-f773-4e3e-a605-730329047c3c tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:40.228092 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-41c0e440-f773-4e3e-a605-730329047c3c tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:40.359581 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-41c0e440-f773-4e3e-a605-730329047c3c tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38047508b7d44f05af7116a15ba7e319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b021c415a147e08dbfede2ddc8cc27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:04:40.367522 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-41c0e440-f773-4e3e-a605-730329047c3c tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/0d30e6dd-58a1-41b7-a675-5bfdb19e7415" status: 200 len: 1366 microversion: 2.1 time: 0.153769 Aug 26 01:04:40.368212 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 515/1024] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:04:40 2022] GET /compute/v2.1/servers/0d30e6dd-58a1-41b7-a675-5bfdb19e7415 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:04:41.388301 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-08ec0f3c-fbe3-4af7-b9fa-a5cf555480db tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:04:41.388966 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-08ec0f3c-fbe3-4af7-b9fa-a5cf555480db tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: 0d30e6dd-58a1-41b7-a675-5bfdb19e7415] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:04:41.395854 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-08ec0f3c-fbe3-4af7-b9fa-a5cf555480db tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:41.396339 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-08ec0f3c-fbe3-4af7-b9fa-a5cf555480db tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:41.396808 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-08ec0f3c-fbe3-4af7-b9fa-a5cf555480db tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:41.397499 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-08ec0f3c-fbe3-4af7-b9fa-a5cf555480db tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:41.397950 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-08ec0f3c-fbe3-4af7-b9fa-a5cf555480db tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:41.398377 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-08ec0f3c-fbe3-4af7-b9fa-a5cf555480db tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:41.527756 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-08ec0f3c-fbe3-4af7-b9fa-a5cf555480db tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38047508b7d44f05af7116a15ba7e319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b021c415a147e08dbfede2ddc8cc27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:04:41.535406 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-08ec0f3c-fbe3-4af7-b9fa-a5cf555480db tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/0d30e6dd-58a1-41b7-a675-5bfdb19e7415" status: 200 len: 1366 microversion: 2.1 time: 0.150992 Aug 26 01:04:41.535972 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 510/1025] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:04:41 2022] GET /compute/v2.1/servers/0d30e6dd-58a1-41b7-a675-5bfdb19e7415 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:04:41.989884 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [req-89d488af-d934-4d5f-a6a1-8f3c75073603 req-e2983c29-1785-4b10-b0e1-b0468adb6708 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d30e6dd-58a1-41b7-a675-5bfdb19e7415", "name": "network-vif-plugged", "status": "completed", "tag": "99c6fe4e-f024-4025-96b6-749ad0bc652c"}]} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:04:41.999243 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-89d488af-d934-4d5f-a6a1-8f3c75073603 req-e2983c29-1785-4b10-b0e1-b0468adb6708 service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:41.999717 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-89d488af-d934-4d5f-a6a1-8f3c75073603 req-e2983c29-1785-4b10-b0e1-b0468adb6708 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:42.000142 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-89d488af-d934-4d5f-a6a1-8f3c75073603 req-e2983c29-1785-4b10-b0e1-b0468adb6708 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:42.010948 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.compute.server_external_events [req-89d488af-d934-4d5f-a6a1-8f3c75073603 req-e2983c29-1785-4b10-b0e1-b0468adb6708 service nova] Creating event network-vif-plugged:99c6fe4e-f024-4025-96b6-749ad0bc652c for instance 0d30e6dd-58a1-41b7-a675-5bfdb19e7415 on hv-cinder-83538 Aug 26 01:04:42.015683 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [req-89d488af-d934-4d5f-a6a1-8f3c75073603 req-e2983c29-1785-4b10-b0e1-b0468adb6708 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146252 Aug 26 01:04:42.016277 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 516/1026] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 01:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:04:42.556880 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-49bc2ffa-1ea0-46c0-8300-9ec86359f28b tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:04:42.557491 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-49bc2ffa-1ea0-46c0-8300-9ec86359f28b tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: 0d30e6dd-58a1-41b7-a675-5bfdb19e7415] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:04:42.559342 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell0:SELECT=2 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:04:42.560050 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell0:SELECT=6 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:04:42.565438 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-49bc2ffa-1ea0-46c0-8300-9ec86359f28b tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:42.566629 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-49bc2ffa-1ea0-46c0-8300-9ec86359f28b tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:42.567574 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-49bc2ffa-1ea0-46c0-8300-9ec86359f28b tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:42.569123 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-49bc2ffa-1ea0-46c0-8300-9ec86359f28b tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:42.569123 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-49bc2ffa-1ea0-46c0-8300-9ec86359f28b tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:42.569410 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-49bc2ffa-1ea0-46c0-8300-9ec86359f28b tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:42.701118 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-49bc2ffa-1ea0-46c0-8300-9ec86359f28b tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38047508b7d44f05af7116a15ba7e319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b021c415a147e08dbfede2ddc8cc27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:04:42.709331 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-49bc2ffa-1ea0-46c0-8300-9ec86359f28b tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/0d30e6dd-58a1-41b7-a675-5bfdb19e7415" status: 200 len: 1366 microversion: 2.1 time: 0.156512 Aug 26 01:04:42.709891 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 511/1027] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:04:42 2022] GET /compute/v2.1/servers/0d30e6dd-58a1-41b7-a675-5bfdb19e7415 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:04:43.727813 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell0:SELECT=6 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:04:43.732323 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-ef146e3c-5027-40ba-b888-80e5764b8d71 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:04:43.733056 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-ef146e3c-5027-40ba-b888-80e5764b8d71 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: 0d30e6dd-58a1-41b7-a675-5bfdb19e7415] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:04:43.739388 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ef146e3c-5027-40ba-b888-80e5764b8d71 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:43.745743 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ef146e3c-5027-40ba-b888-80e5764b8d71 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:43.745743 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ef146e3c-5027-40ba-b888-80e5764b8d71 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:43.745743 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ef146e3c-5027-40ba-b888-80e5764b8d71 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:43.745743 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ef146e3c-5027-40ba-b888-80e5764b8d71 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:43.746146 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ef146e3c-5027-40ba-b888-80e5764b8d71 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:43.873544 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-ef146e3c-5027-40ba-b888-80e5764b8d71 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38047508b7d44f05af7116a15ba7e319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b021c415a147e08dbfede2ddc8cc27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:04:43.881060 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-ef146e3c-5027-40ba-b888-80e5764b8d71 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/0d30e6dd-58a1-41b7-a675-5bfdb19e7415" status: 200 len: 1366 microversion: 2.1 time: 0.154273 Aug 26 01:04:43.881610 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 517/1028] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:04:43 2022] GET /compute/v2.1/servers/0d30e6dd-58a1-41b7-a675-5bfdb19e7415 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:04:44.900915 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-346588a1-d01b-4083-9b3c-ff4d77494304 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:04:44.901528 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-346588a1-d01b-4083-9b3c-ff4d77494304 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: 0d30e6dd-58a1-41b7-a675-5bfdb19e7415] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:04:44.907844 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-346588a1-d01b-4083-9b3c-ff4d77494304 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:44.908322 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-346588a1-d01b-4083-9b3c-ff4d77494304 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:44.908783 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-346588a1-d01b-4083-9b3c-ff4d77494304 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:44.909473 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-346588a1-d01b-4083-9b3c-ff4d77494304 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:44.909923 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-346588a1-d01b-4083-9b3c-ff4d77494304 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:44.910348 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-346588a1-d01b-4083-9b3c-ff4d77494304 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:45.041288 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-346588a1-d01b-4083-9b3c-ff4d77494304 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38047508b7d44f05af7116a15ba7e319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b021c415a147e08dbfede2ddc8cc27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:04:45.049152 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-346588a1-d01b-4083-9b3c-ff4d77494304 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/0d30e6dd-58a1-41b7-a675-5bfdb19e7415" status: 200 len: 1556 microversion: 2.1 time: 0.152145 Aug 26 01:04:45.053846 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 512/1029] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:04:44 2022] GET /compute/v2.1/servers/0d30e6dd-58a1-41b7-a675-5bfdb19e7415 => generated 1556 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:04:45.069347 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-635a7125-0bbd-4e9c-9253-0658487c8f42 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:04:45.069865 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-635a7125-0bbd-4e9c-9253-0658487c8f42 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: 0d30e6dd-58a1-41b7-a675-5bfdb19e7415] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:04:45.076340 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-635a7125-0bbd-4e9c-9253-0658487c8f42 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:45.082239 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-635a7125-0bbd-4e9c-9253-0658487c8f42 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:45.082239 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-635a7125-0bbd-4e9c-9253-0658487c8f42 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:45.082239 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-635a7125-0bbd-4e9c-9253-0658487c8f42 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:45.082239 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-635a7125-0bbd-4e9c-9253-0658487c8f42 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:45.082703 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-635a7125-0bbd-4e9c-9253-0658487c8f42 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:45.159742 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-635a7125-0bbd-4e9c-9253-0658487c8f42 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/0d30e6dd-58a1-41b7-a675-5bfdb19e7415/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094153 Aug 26 01:04:45.160332 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 518/1030] 10.222.0.59 () {58 vars in 1275 bytes} [Fri Aug 26 01:04:45 2022] GET /compute/v2.1/servers/0d30e6dd-58a1-41b7-a675-5bfdb19e7415/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:04:46.136716 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [req-1c952bf0-c39e-47ad-9a0f-932466941e4b req-83b2733a-709e-49a8-9958-bc9983e134fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d30e6dd-58a1-41b7-a675-5bfdb19e7415", "tag": "99c6fe4e-f024-4025-96b6-749ad0bc652c"}]} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:04:46.146606 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-1c952bf0-c39e-47ad-9a0f-932466941e4b req-83b2733a-709e-49a8-9958-bc9983e134fd service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:46.147080 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-1c952bf0-c39e-47ad-9a0f-932466941e4b req-83b2733a-709e-49a8-9958-bc9983e134fd service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:46.147510 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-1c952bf0-c39e-47ad-9a0f-932466941e4b req-83b2733a-709e-49a8-9958-bc9983e134fd service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:46.158261 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.compute.server_external_events [req-1c952bf0-c39e-47ad-9a0f-932466941e4b req-83b2733a-709e-49a8-9958-bc9983e134fd service nova] Creating event network-changed:99c6fe4e-f024-4025-96b6-749ad0bc652c for instance 0d30e6dd-58a1-41b7-a675-5bfdb19e7415 on hv-cinder-83538 Aug 26 01:04:46.163557 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [req-1c952bf0-c39e-47ad-9a0f-932466941e4b req-83b2733a-709e-49a8-9958-bc9983e134fd service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030614 Aug 26 01:04:46.164123 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 513/1031] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 01:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:04:46.371181 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-5bc7e433-483e-496b-9bbf-27bb52c033dc tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:04:46.371763 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-5bc7e433-483e-496b-9bbf-27bb52c033dc tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] [instance: d63711c4-8adf-43bd-9822-b8f82055f35f] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:04:46.377874 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5bc7e433-483e-496b-9bbf-27bb52c033dc tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:46.378434 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5bc7e433-483e-496b-9bbf-27bb52c033dc tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:46.378934 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5bc7e433-483e-496b-9bbf-27bb52c033dc tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:46.387765 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5bc7e433-483e-496b-9bbf-27bb52c033dc tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:46.388418 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5bc7e433-483e-496b-9bbf-27bb52c033dc tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:46.388958 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5bc7e433-483e-496b-9bbf-27bb52c033dc tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:46.416383 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.objects.instance [None req-5bc7e433-483e-496b-9bbf-27bb52c033dc tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lazy-loading 'flavor' on Instance uuid d63711c4-8adf-43bd-9822-b8f82055f35f {{(pid=127564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 01:04:46.767659 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-5bc7e433-483e-496b-9bbf-27bb52c033dc tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] 10.222.0.59 "POST /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f/action" status: 202 len: 0 microversion: 2.1 time: 0.400803 Aug 26 01:04:46.770028 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 519/1032] 10.222.0.59 () {60 vars in 1278 bytes} [Fri Aug 26 01:04:46 2022] POST /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f/action => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 01:04:46.778511 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-8647ef18-8b53-4dac-b284-0a2555a999d0 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:04:46.779324 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-8647ef18-8b53-4dac-b284-0a2555a999d0 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] [instance: d63711c4-8adf-43bd-9822-b8f82055f35f] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:04:46.785840 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8647ef18-8b53-4dac-b284-0a2555a999d0 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:46.787110 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8647ef18-8b53-4dac-b284-0a2555a999d0 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:46.787563 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8647ef18-8b53-4dac-b284-0a2555a999d0 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:46.788273 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8647ef18-8b53-4dac-b284-0a2555a999d0 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:46.788759 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8647ef18-8b53-4dac-b284-0a2555a999d0 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:46.789194 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8647ef18-8b53-4dac-b284-0a2555a999d0 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:46.926052 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-8647ef18-8b53-4dac-b284-0a2555a999d0 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83076e7b11fb446ca50f23fe8e6e7ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a223be1c2f6a4cd281b20b0bc7281554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:04:46.934699 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-8647ef18-8b53-4dac-b284-0a2555a999d0 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] 10.222.0.59 "GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f" status: 200 len: 1567 microversion: 2.1 time: 0.161645 Aug 26 01:04:46.936514 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 514/1033] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:04:46 2022] GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:04:47.957249 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-58f7bd41-5a8e-40fe-bd3d-dcfa99c119aa tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:04:47.958194 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-58f7bd41-5a8e-40fe-bd3d-dcfa99c119aa tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] [instance: d63711c4-8adf-43bd-9822-b8f82055f35f] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:04:47.965023 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-58f7bd41-5a8e-40fe-bd3d-dcfa99c119aa tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:47.965510 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-58f7bd41-5a8e-40fe-bd3d-dcfa99c119aa tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:47.965945 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-58f7bd41-5a8e-40fe-bd3d-dcfa99c119aa tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:47.966631 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-58f7bd41-5a8e-40fe-bd3d-dcfa99c119aa tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:47.967082 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-58f7bd41-5a8e-40fe-bd3d-dcfa99c119aa tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:47.967508 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-58f7bd41-5a8e-40fe-bd3d-dcfa99c119aa tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:48.101996 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-58f7bd41-5a8e-40fe-bd3d-dcfa99c119aa tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83076e7b11fb446ca50f23fe8e6e7ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a223be1c2f6a4cd281b20b0bc7281554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:04:48.109807 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-58f7bd41-5a8e-40fe-bd3d-dcfa99c119aa tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] 10.222.0.59 "GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f" status: 200 len: 1567 microversion: 2.1 time: 0.157228 Aug 26 01:04:48.110369 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 520/1034] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:04:47 2022] GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:04:49.131473 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-f05cb069-af9d-4848-8138-158537e5638a tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:04:49.132091 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-f05cb069-af9d-4848-8138-158537e5638a tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] [instance: d63711c4-8adf-43bd-9822-b8f82055f35f] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:04:49.138492 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f05cb069-af9d-4848-8138-158537e5638a tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:49.138972 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f05cb069-af9d-4848-8138-158537e5638a tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:49.139416 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f05cb069-af9d-4848-8138-158537e5638a tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:49.140105 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f05cb069-af9d-4848-8138-158537e5638a tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:49.140597 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f05cb069-af9d-4848-8138-158537e5638a tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:49.141024 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f05cb069-af9d-4848-8138-158537e5638a tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:49.275274 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-f05cb069-af9d-4848-8138-158537e5638a tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83076e7b11fb446ca50f23fe8e6e7ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a223be1c2f6a4cd281b20b0bc7281554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:04:49.283386 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-f05cb069-af9d-4848-8138-158537e5638a tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] 10.222.0.59 "GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f" status: 200 len: 1567 microversion: 2.1 time: 0.156461 Aug 26 01:04:49.283948 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 515/1035] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:04:49 2022] GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:04:50.305333 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-64f323e5-ed48-4c78-8ec8-115a1b0ae702 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:04:50.305873 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-64f323e5-ed48-4c78-8ec8-115a1b0ae702 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] [instance: d63711c4-8adf-43bd-9822-b8f82055f35f] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:04:50.312241 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-64f323e5-ed48-4c78-8ec8-115a1b0ae702 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:50.312749 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-64f323e5-ed48-4c78-8ec8-115a1b0ae702 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:50.313177 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-64f323e5-ed48-4c78-8ec8-115a1b0ae702 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:50.313856 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-64f323e5-ed48-4c78-8ec8-115a1b0ae702 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:50.314298 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-64f323e5-ed48-4c78-8ec8-115a1b0ae702 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:50.314716 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-64f323e5-ed48-4c78-8ec8-115a1b0ae702 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:50.443822 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-64f323e5-ed48-4c78-8ec8-115a1b0ae702 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83076e7b11fb446ca50f23fe8e6e7ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a223be1c2f6a4cd281b20b0bc7281554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:04:50.451555 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-64f323e5-ed48-4c78-8ec8-115a1b0ae702 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] 10.222.0.59 "GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f" status: 200 len: 1567 microversion: 2.1 time: 0.150187 Aug 26 01:04:50.452106 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 521/1036] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:04:50 2022] GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:04:51.472346 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-6b384f16-99d1-4453-97a0-6e98506db6b4 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:04:51.472984 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-6b384f16-99d1-4453-97a0-6e98506db6b4 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] [instance: d63711c4-8adf-43bd-9822-b8f82055f35f] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:04:51.480012 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6b384f16-99d1-4453-97a0-6e98506db6b4 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:51.480518 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6b384f16-99d1-4453-97a0-6e98506db6b4 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:51.481148 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6b384f16-99d1-4453-97a0-6e98506db6b4 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:51.481838 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6b384f16-99d1-4453-97a0-6e98506db6b4 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:51.482286 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6b384f16-99d1-4453-97a0-6e98506db6b4 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:51.482702 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6b384f16-99d1-4453-97a0-6e98506db6b4 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:51.610212 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-6b384f16-99d1-4453-97a0-6e98506db6b4 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83076e7b11fb446ca50f23fe8e6e7ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a223be1c2f6a4cd281b20b0bc7281554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:04:51.617950 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-6b384f16-99d1-4453-97a0-6e98506db6b4 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] 10.222.0.59 "GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f" status: 200 len: 1567 microversion: 2.1 time: 0.149506 Aug 26 01:04:51.618521 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 516/1037] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:04:51 2022] GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:04:52.639425 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-cbbc2760-3d7e-4c22-b1f2-8bf3b96a044b tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:04:52.640041 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-cbbc2760-3d7e-4c22-b1f2-8bf3b96a044b tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] [instance: d63711c4-8adf-43bd-9822-b8f82055f35f] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:04:52.646824 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-cbbc2760-3d7e-4c22-b1f2-8bf3b96a044b tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:52.647310 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-cbbc2760-3d7e-4c22-b1f2-8bf3b96a044b tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:52.647748 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-cbbc2760-3d7e-4c22-b1f2-8bf3b96a044b tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:52.648437 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-cbbc2760-3d7e-4c22-b1f2-8bf3b96a044b tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:52.648919 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-cbbc2760-3d7e-4c22-b1f2-8bf3b96a044b tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:52.649344 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-cbbc2760-3d7e-4c22-b1f2-8bf3b96a044b tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:52.779036 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-cbbc2760-3d7e-4c22-b1f2-8bf3b96a044b tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83076e7b11fb446ca50f23fe8e6e7ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a223be1c2f6a4cd281b20b0bc7281554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:04:52.787793 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-cbbc2760-3d7e-4c22-b1f2-8bf3b96a044b tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] 10.222.0.59 "GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f" status: 200 len: 1567 microversion: 2.1 time: 0.151360 Aug 26 01:04:52.788272 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 522/1038] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:04:52 2022] GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:04:53.809423 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-36389cf8-36cb-47d4-8f64-24fb9d82a31a tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:04:53.810042 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-36389cf8-36cb-47d4-8f64-24fb9d82a31a tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] [instance: d63711c4-8adf-43bd-9822-b8f82055f35f] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:04:53.816591 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-36389cf8-36cb-47d4-8f64-24fb9d82a31a tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:53.817075 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-36389cf8-36cb-47d4-8f64-24fb9d82a31a tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:53.817511 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-36389cf8-36cb-47d4-8f64-24fb9d82a31a tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:53.818198 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-36389cf8-36cb-47d4-8f64-24fb9d82a31a tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:53.818647 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-36389cf8-36cb-47d4-8f64-24fb9d82a31a tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:53.819164 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-36389cf8-36cb-47d4-8f64-24fb9d82a31a tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:53.963608 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-36389cf8-36cb-47d4-8f64-24fb9d82a31a tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83076e7b11fb446ca50f23fe8e6e7ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a223be1c2f6a4cd281b20b0bc7281554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:04:53.971428 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-36389cf8-36cb-47d4-8f64-24fb9d82a31a tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] 10.222.0.59 "GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f" status: 200 len: 1567 microversion: 2.1 time: 0.165906 Aug 26 01:04:53.972027 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 517/1039] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:04:53 2022] GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:04:54.992891 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-bcf9bd1b-ced4-4b5e-9602-31044368c57e tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:04:54.993503 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-bcf9bd1b-ced4-4b5e-9602-31044368c57e tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] [instance: d63711c4-8adf-43bd-9822-b8f82055f35f] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:04:54.999949 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bcf9bd1b-ced4-4b5e-9602-31044368c57e tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:55.000429 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bcf9bd1b-ced4-4b5e-9602-31044368c57e tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:55.000894 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bcf9bd1b-ced4-4b5e-9602-31044368c57e tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:55.001606 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bcf9bd1b-ced4-4b5e-9602-31044368c57e tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:55.002057 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bcf9bd1b-ced4-4b5e-9602-31044368c57e tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:55.002480 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bcf9bd1b-ced4-4b5e-9602-31044368c57e tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:55.006511 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell1:SELECT=79,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:04:55.394417 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-bcf9bd1b-ced4-4b5e-9602-31044368c57e tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83076e7b11fb446ca50f23fe8e6e7ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a223be1c2f6a4cd281b20b0bc7281554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:04:55.402716 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-bcf9bd1b-ced4-4b5e-9602-31044368c57e tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] 10.222.0.59 "GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f" status: 200 len: 1567 microversion: 2.1 time: 0.413655 Aug 26 01:04:55.403288 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 523/1040] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:04:54 2022] GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f => generated 1567 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:04:56.423130 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-5ad64adf-07aa-4e26-bc66-679bcfe877fe tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:04:56.423766 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-5ad64adf-07aa-4e26-bc66-679bcfe877fe tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] [instance: d63711c4-8adf-43bd-9822-b8f82055f35f] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:04:56.430332 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5ad64adf-07aa-4e26-bc66-679bcfe877fe tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:56.430816 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5ad64adf-07aa-4e26-bc66-679bcfe877fe tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:56.431292 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5ad64adf-07aa-4e26-bc66-679bcfe877fe tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:56.435838 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5ad64adf-07aa-4e26-bc66-679bcfe877fe tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:56.435838 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5ad64adf-07aa-4e26-bc66-679bcfe877fe tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:56.435838 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5ad64adf-07aa-4e26-bc66-679bcfe877fe tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:56.563317 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-5ad64adf-07aa-4e26-bc66-679bcfe877fe tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83076e7b11fb446ca50f23fe8e6e7ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a223be1c2f6a4cd281b20b0bc7281554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:04:56.571285 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-5ad64adf-07aa-4e26-bc66-679bcfe877fe tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] 10.222.0.59 "GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f" status: 200 len: 1567 microversion: 2.1 time: 0.152020 Aug 26 01:04:56.571846 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 518/1041] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:04:56 2022] GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:04:57.592742 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-5d44aac5-a397-43b5-a795-d23b51b34dfd tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:04:57.593349 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-5d44aac5-a397-43b5-a795-d23b51b34dfd tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] [instance: d63711c4-8adf-43bd-9822-b8f82055f35f] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:04:57.599794 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5d44aac5-a397-43b5-a795-d23b51b34dfd tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:57.600829 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5d44aac5-a397-43b5-a795-d23b51b34dfd tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:57.601261 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5d44aac5-a397-43b5-a795-d23b51b34dfd tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:57.601950 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5d44aac5-a397-43b5-a795-d23b51b34dfd tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:57.602388 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5d44aac5-a397-43b5-a795-d23b51b34dfd tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:57.602813 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5d44aac5-a397-43b5-a795-d23b51b34dfd tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:57.740321 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-5d44aac5-a397-43b5-a795-d23b51b34dfd tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83076e7b11fb446ca50f23fe8e6e7ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a223be1c2f6a4cd281b20b0bc7281554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:04:57.748188 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-5d44aac5-a397-43b5-a795-d23b51b34dfd tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] 10.222.0.59 "GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f" status: 200 len: 1567 microversion: 2.1 time: 0.159331 Aug 26 01:04:57.748786 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 524/1042] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:04:57 2022] GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:04:58.769248 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-1c59cd9e-e605-4cea-b234-fb2d06bcc73c tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:04:58.769807 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-1c59cd9e-e605-4cea-b234-fb2d06bcc73c tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] [instance: d63711c4-8adf-43bd-9822-b8f82055f35f] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:04:58.776229 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1c59cd9e-e605-4cea-b234-fb2d06bcc73c tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:58.776743 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1c59cd9e-e605-4cea-b234-fb2d06bcc73c tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:58.777186 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1c59cd9e-e605-4cea-b234-fb2d06bcc73c tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:58.777872 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1c59cd9e-e605-4cea-b234-fb2d06bcc73c tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:58.778327 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1c59cd9e-e605-4cea-b234-fb2d06bcc73c tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:58.778755 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1c59cd9e-e605-4cea-b234-fb2d06bcc73c tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:58.907751 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-1c59cd9e-e605-4cea-b234-fb2d06bcc73c tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83076e7b11fb446ca50f23fe8e6e7ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a223be1c2f6a4cd281b20b0bc7281554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:04:58.915690 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-1c59cd9e-e605-4cea-b234-fb2d06bcc73c tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] 10.222.0.59 "GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f" status: 200 len: 1567 microversion: 2.1 time: 0.150404 Aug 26 01:04:58.916282 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 519/1043] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:04:58 2022] GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:04:59.936978 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-ef64d2d9-001c-4222-9673-f7fec2c65062 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:04:59.937747 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-ef64d2d9-001c-4222-9673-f7fec2c65062 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] [instance: d63711c4-8adf-43bd-9822-b8f82055f35f] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:04:59.947727 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ef64d2d9-001c-4222-9673-f7fec2c65062 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:59.947727 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ef64d2d9-001c-4222-9673-f7fec2c65062 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:59.947727 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ef64d2d9-001c-4222-9673-f7fec2c65062 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:04:59.947727 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ef64d2d9-001c-4222-9673-f7fec2c65062 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:04:59.948169 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ef64d2d9-001c-4222-9673-f7fec2c65062 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:04:59.948169 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ef64d2d9-001c-4222-9673-f7fec2c65062 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:00.087832 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-ef64d2d9-001c-4222-9673-f7fec2c65062 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83076e7b11fb446ca50f23fe8e6e7ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a223be1c2f6a4cd281b20b0bc7281554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:05:00.095623 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-ef64d2d9-001c-4222-9673-f7fec2c65062 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] 10.222.0.59 "GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f" status: 200 len: 1567 microversion: 2.1 time: 0.162745 Aug 26 01:05:00.096207 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 525/1044] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:04:59 2022] GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:05:01.117256 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-06c223ee-9d0e-41dd-9dd7-f2880db1550d tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:05:01.117796 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-06c223ee-9d0e-41dd-9dd7-f2880db1550d tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] [instance: d63711c4-8adf-43bd-9822-b8f82055f35f] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:05:01.124551 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-06c223ee-9d0e-41dd-9dd7-f2880db1550d tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:01.125048 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-06c223ee-9d0e-41dd-9dd7-f2880db1550d tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:01.125486 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-06c223ee-9d0e-41dd-9dd7-f2880db1550d tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:01.126175 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-06c223ee-9d0e-41dd-9dd7-f2880db1550d tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:01.126629 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-06c223ee-9d0e-41dd-9dd7-f2880db1550d tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:01.127053 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-06c223ee-9d0e-41dd-9dd7-f2880db1550d tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:01.261130 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-06c223ee-9d0e-41dd-9dd7-f2880db1550d tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83076e7b11fb446ca50f23fe8e6e7ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a223be1c2f6a4cd281b20b0bc7281554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:05:01.268945 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-06c223ee-9d0e-41dd-9dd7-f2880db1550d tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] 10.222.0.59 "GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f" status: 200 len: 1568 microversion: 2.1 time: 0.155663 Aug 26 01:05:01.291110 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 520/1045] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:05:01 2022] GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:05:01.291267 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-3432068d-86aa-4aed-8040-5436cd29c337 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:05:01.291267 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-3432068d-86aa-4aed-8040-5436cd29c337 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] [instance: d63711c4-8adf-43bd-9822-b8f82055f35f] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:05:01.296815 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3432068d-86aa-4aed-8040-5436cd29c337 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:01.297375 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3432068d-86aa-4aed-8040-5436cd29c337 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:01.297730 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3432068d-86aa-4aed-8040-5436cd29c337 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:01.298420 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3432068d-86aa-4aed-8040-5436cd29c337 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:01.298911 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3432068d-86aa-4aed-8040-5436cd29c337 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:01.299337 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3432068d-86aa-4aed-8040-5436cd29c337 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:01.328326 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-3432068d-86aa-4aed-8040-5436cd29c337 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] [instance: d63711c4-8adf-43bd-9822-b8f82055f35f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127564) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 26 01:05:01.703134 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-3432068d-86aa-4aed-8040-5436cd29c337 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] 10.222.0.59 "POST /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f/action" status: 202 len: 0 microversion: 2.1 time: 0.417429 Aug 26 01:05:01.703660 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 526/1046] 10.222.0.59 () {60 vars in 1278 bytes} [Fri Aug 26 01:05:01 2022] POST /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f/action => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 01:05:01.711676 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-8ff10d8f-e81d-413f-80af-51ccd31f7abc tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:05:01.712282 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-8ff10d8f-e81d-413f-80af-51ccd31f7abc tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] [instance: d63711c4-8adf-43bd-9822-b8f82055f35f] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:05:01.718455 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8ff10d8f-e81d-413f-80af-51ccd31f7abc tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:01.721914 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8ff10d8f-e81d-413f-80af-51ccd31f7abc tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:01.721914 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8ff10d8f-e81d-413f-80af-51ccd31f7abc tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:01.721914 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8ff10d8f-e81d-413f-80af-51ccd31f7abc tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:01.721914 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8ff10d8f-e81d-413f-80af-51ccd31f7abc tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:01.722330 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8ff10d8f-e81d-413f-80af-51ccd31f7abc tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:01.859023 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-8ff10d8f-e81d-413f-80af-51ccd31f7abc tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83076e7b11fb446ca50f23fe8e6e7ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a223be1c2f6a4cd281b20b0bc7281554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:05:01.861073 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [req-9e5bc058-ae06-4da3-85af-029ab46383f4 req-541673cc-9666-4f3c-a45e-9df7a614a4b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d63711c4-8adf-43bd-9822-b8f82055f35f", "name": "network-vif-unplugged", "status": "completed", "tag": "8d821bb5-fb83-42d7-b1c5-f97cf0d2ca3f"}]} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:05:01.868570 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-8ff10d8f-e81d-413f-80af-51ccd31f7abc tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] 10.222.0.59 "GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f" status: 200 len: 1516 microversion: 2.1 time: 0.160614 Aug 26 01:05:01.876532 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 521/1047] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:05:01 2022] GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:05:01.876945 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-9e5bc058-ae06-4da3-85af-029ab46383f4 req-541673cc-9666-4f3c-a45e-9df7a614a4b9 service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:01.876945 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-9e5bc058-ae06-4da3-85af-029ab46383f4 req-541673cc-9666-4f3c-a45e-9df7a614a4b9 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:01.876945 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-9e5bc058-ae06-4da3-85af-029ab46383f4 req-541673cc-9666-4f3c-a45e-9df7a614a4b9 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:01.884222 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.compute.server_external_events [req-9e5bc058-ae06-4da3-85af-029ab46383f4 req-541673cc-9666-4f3c-a45e-9df7a614a4b9 service nova] Unable to find a host for instance d63711c4-8adf-43bd-9822-b8f82055f35f. Dropping event network-vif-unplugged {{(pid=127564) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 26 01:05:01.885002 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [req-9e5bc058-ae06-4da3-85af-029ab46383f4 req-541673cc-9666-4f3c-a45e-9df7a614a4b9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027673 Aug 26 01:05:01.885644 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 527/1048] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 01:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 26 01:05:02.889917 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-88f58ad0-acb9-4106-b6c8-6f132a40821d tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:05:02.890619 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-88f58ad0-acb9-4106-b6c8-6f132a40821d tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] [instance: d63711c4-8adf-43bd-9822-b8f82055f35f] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:05:02.897110 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-88f58ad0-acb9-4106-b6c8-6f132a40821d tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:02.897591 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-88f58ad0-acb9-4106-b6c8-6f132a40821d tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:02.898025 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-88f58ad0-acb9-4106-b6c8-6f132a40821d tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:02.898755 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-88f58ad0-acb9-4106-b6c8-6f132a40821d tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:02.899738 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-88f58ad0-acb9-4106-b6c8-6f132a40821d tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:02.900150 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-88f58ad0-acb9-4106-b6c8-6f132a40821d tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:03.035292 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-88f58ad0-acb9-4106-b6c8-6f132a40821d tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83076e7b11fb446ca50f23fe8e6e7ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a223be1c2f6a4cd281b20b0bc7281554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:05:03.043397 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-88f58ad0-acb9-4106-b6c8-6f132a40821d tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] 10.222.0.59 "GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f" status: 200 len: 1518 microversion: 2.1 time: 0.157321 Aug 26 01:05:03.043974 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 522/1049] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:05:02 2022] GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:05:04.064818 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-e0834a93-96ec-4279-8f2f-0588a6406722 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:05:04.065436 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-e0834a93-96ec-4279-8f2f-0588a6406722 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] [instance: d63711c4-8adf-43bd-9822-b8f82055f35f] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:05:04.071767 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e0834a93-96ec-4279-8f2f-0588a6406722 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:04.072247 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e0834a93-96ec-4279-8f2f-0588a6406722 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:04.072728 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e0834a93-96ec-4279-8f2f-0588a6406722 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:04.073417 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e0834a93-96ec-4279-8f2f-0588a6406722 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:04.073871 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e0834a93-96ec-4279-8f2f-0588a6406722 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:04.074295 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e0834a93-96ec-4279-8f2f-0588a6406722 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:04.204005 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-e0834a93-96ec-4279-8f2f-0588a6406722 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83076e7b11fb446ca50f23fe8e6e7ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a223be1c2f6a4cd281b20b0bc7281554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:05:04.211889 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-e0834a93-96ec-4279-8f2f-0588a6406722 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] 10.222.0.59 "GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f" status: 200 len: 1518 microversion: 2.1 time: 0.150900 Aug 26 01:05:04.212461 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 528/1050] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:05:04 2022] GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f => generated 1518 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:05:05.233272 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-66ecf3cd-4c1e-4395-b653-5e8731c71ecb tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:05:05.233878 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-66ecf3cd-4c1e-4395-b653-5e8731c71ecb tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] [instance: d63711c4-8adf-43bd-9822-b8f82055f35f] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:05:05.240322 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-66ecf3cd-4c1e-4395-b653-5e8731c71ecb tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:05.240835 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-66ecf3cd-4c1e-4395-b653-5e8731c71ecb tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:05.241260 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-66ecf3cd-4c1e-4395-b653-5e8731c71ecb tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:05.241941 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-66ecf3cd-4c1e-4395-b653-5e8731c71ecb tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:05.242386 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-66ecf3cd-4c1e-4395-b653-5e8731c71ecb tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:05.242802 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-66ecf3cd-4c1e-4395-b653-5e8731c71ecb tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:05.257988 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell1:SELECT=100 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:05:05.375145 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-66ecf3cd-4c1e-4395-b653-5e8731c71ecb tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83076e7b11fb446ca50f23fe8e6e7ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a223be1c2f6a4cd281b20b0bc7281554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:05:05.383071 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-66ecf3cd-4c1e-4395-b653-5e8731c71ecb tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] 10.222.0.59 "GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f" status: 200 len: 1574 microversion: 2.1 time: 0.153652 Aug 26 01:05:05.383682 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 523/1051] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:05:05 2022] GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:05:06.405742 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-212b16ba-c73c-43e6-aef1-9c9f06eead8b tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:05:06.406363 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-212b16ba-c73c-43e6-aef1-9c9f06eead8b tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] [instance: d63711c4-8adf-43bd-9822-b8f82055f35f] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:05:06.413232 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-212b16ba-c73c-43e6-aef1-9c9f06eead8b tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:06.413722 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-212b16ba-c73c-43e6-aef1-9c9f06eead8b tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:06.414364 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-212b16ba-c73c-43e6-aef1-9c9f06eead8b tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:06.415484 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-212b16ba-c73c-43e6-aef1-9c9f06eead8b tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:06.419670 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-212b16ba-c73c-43e6-aef1-9c9f06eead8b tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:06.420938 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-212b16ba-c73c-43e6-aef1-9c9f06eead8b tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:06.572451 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-212b16ba-c73c-43e6-aef1-9c9f06eead8b tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83076e7b11fb446ca50f23fe8e6e7ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a223be1c2f6a4cd281b20b0bc7281554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:05:06.580220 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-212b16ba-c73c-43e6-aef1-9c9f06eead8b tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] 10.222.0.59 "GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f" status: 200 len: 1574 microversion: 2.1 time: 0.178916 Aug 26 01:05:06.580914 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 529/1052] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:05:06 2022] GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f => generated 1574 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:05:07.600982 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-c69a7da4-f12c-4909-a8f6-e34683a8f8d6 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:05:07.601592 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-c69a7da4-f12c-4909-a8f6-e34683a8f8d6 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] [instance: d63711c4-8adf-43bd-9822-b8f82055f35f] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:05:07.604460 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_api:SELECT=34 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:05:07.609274 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c69a7da4-f12c-4909-a8f6-e34683a8f8d6 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:07.613022 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c69a7da4-f12c-4909-a8f6-e34683a8f8d6 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:07.613022 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c69a7da4-f12c-4909-a8f6-e34683a8f8d6 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:07.613022 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c69a7da4-f12c-4909-a8f6-e34683a8f8d6 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:07.613022 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c69a7da4-f12c-4909-a8f6-e34683a8f8d6 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:07.613451 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c69a7da4-f12c-4909-a8f6-e34683a8f8d6 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:07.746080 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-c69a7da4-f12c-4909-a8f6-e34683a8f8d6 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83076e7b11fb446ca50f23fe8e6e7ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a223be1c2f6a4cd281b20b0bc7281554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:05:07.753836 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-c69a7da4-f12c-4909-a8f6-e34683a8f8d6 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] 10.222.0.59 "GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f" status: 200 len: 1574 microversion: 2.1 time: 0.156701 Aug 26 01:05:07.754442 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 524/1053] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:05:07 2022] GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:05:08.774753 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-fefe15cb-c477-4985-b64f-866aee6a0133 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:05:08.775953 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-fefe15cb-c477-4985-b64f-866aee6a0133 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] [instance: d63711c4-8adf-43bd-9822-b8f82055f35f] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:05:08.778386 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:05:08.783556 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fefe15cb-c477-4985-b64f-866aee6a0133 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:08.784033 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fefe15cb-c477-4985-b64f-866aee6a0133 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:08.784463 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fefe15cb-c477-4985-b64f-866aee6a0133 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:08.785173 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fefe15cb-c477-4985-b64f-866aee6a0133 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:08.785624 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fefe15cb-c477-4985-b64f-866aee6a0133 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:08.788727 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fefe15cb-c477-4985-b64f-866aee6a0133 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:08.915923 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-fefe15cb-c477-4985-b64f-866aee6a0133 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83076e7b11fb446ca50f23fe8e6e7ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a223be1c2f6a4cd281b20b0bc7281554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:05:08.923593 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-fefe15cb-c477-4985-b64f-866aee6a0133 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] 10.222.0.59 "GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f" status: 200 len: 1574 microversion: 2.1 time: 0.152804 Aug 26 01:05:08.924152 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 530/1054] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:05:08 2022] GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:05:09.944253 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-ce1abaa2-4ede-46c6-8d0b-5afec7c64be0 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:05:09.944891 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-ce1abaa2-4ede-46c6-8d0b-5afec7c64be0 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] [instance: d63711c4-8adf-43bd-9822-b8f82055f35f] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:05:09.951878 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ce1abaa2-4ede-46c6-8d0b-5afec7c64be0 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:09.952357 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ce1abaa2-4ede-46c6-8d0b-5afec7c64be0 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:09.952826 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ce1abaa2-4ede-46c6-8d0b-5afec7c64be0 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:09.953509 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ce1abaa2-4ede-46c6-8d0b-5afec7c64be0 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:09.953960 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ce1abaa2-4ede-46c6-8d0b-5afec7c64be0 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:09.954379 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ce1abaa2-4ede-46c6-8d0b-5afec7c64be0 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:10.084890 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-ce1abaa2-4ede-46c6-8d0b-5afec7c64be0 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83076e7b11fb446ca50f23fe8e6e7ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a223be1c2f6a4cd281b20b0bc7281554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:05:10.092873 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-ce1abaa2-4ede-46c6-8d0b-5afec7c64be0 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] 10.222.0.59 "GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f" status: 200 len: 1574 microversion: 2.1 time: 0.152471 Aug 26 01:05:10.093470 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 525/1055] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:05:09 2022] GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:05:11.116546 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-993259e7-7f75-45c0-bb0d-e50cf97ff147 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:05:11.117160 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-993259e7-7f75-45c0-bb0d-e50cf97ff147 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] [instance: d63711c4-8adf-43bd-9822-b8f82055f35f] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:05:11.124940 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-993259e7-7f75-45c0-bb0d-e50cf97ff147 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:11.125448 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-993259e7-7f75-45c0-bb0d-e50cf97ff147 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:11.125887 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-993259e7-7f75-45c0-bb0d-e50cf97ff147 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:11.126583 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-993259e7-7f75-45c0-bb0d-e50cf97ff147 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:11.127037 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-993259e7-7f75-45c0-bb0d-e50cf97ff147 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:11.127461 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-993259e7-7f75-45c0-bb0d-e50cf97ff147 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:11.261008 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-993259e7-7f75-45c0-bb0d-e50cf97ff147 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83076e7b11fb446ca50f23fe8e6e7ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a223be1c2f6a4cd281b20b0bc7281554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:05:11.268719 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-993259e7-7f75-45c0-bb0d-e50cf97ff147 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] 10.222.0.59 "GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f" status: 200 len: 1574 microversion: 2.1 time: 0.155976 Aug 26 01:05:11.269279 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 531/1056] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:05:11 2022] GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:05:12.290492 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-a708e317-835c-4480-80c7-5e10f1cbd41f tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:05:12.291100 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-a708e317-835c-4480-80c7-5e10f1cbd41f tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] [instance: d63711c4-8adf-43bd-9822-b8f82055f35f] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:05:12.298316 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a708e317-835c-4480-80c7-5e10f1cbd41f tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:12.298796 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a708e317-835c-4480-80c7-5e10f1cbd41f tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:12.299223 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a708e317-835c-4480-80c7-5e10f1cbd41f tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:12.299901 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a708e317-835c-4480-80c7-5e10f1cbd41f tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:12.300348 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a708e317-835c-4480-80c7-5e10f1cbd41f tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:12.300802 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-a708e317-835c-4480-80c7-5e10f1cbd41f tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:12.431406 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-a708e317-835c-4480-80c7-5e10f1cbd41f tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83076e7b11fb446ca50f23fe8e6e7ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a223be1c2f6a4cd281b20b0bc7281554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:05:12.440133 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-a708e317-835c-4480-80c7-5e10f1cbd41f tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] 10.222.0.59 "GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f" status: 200 len: 1574 microversion: 2.1 time: 0.153666 Aug 26 01:05:12.440759 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 526/1057] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:05:12 2022] GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:05:13.461644 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-f193e602-c910-4080-bcce-abccabd67067 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:05:13.462248 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-f193e602-c910-4080-bcce-abccabd67067 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] [instance: d63711c4-8adf-43bd-9822-b8f82055f35f] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:05:13.469206 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f193e602-c910-4080-bcce-abccabd67067 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:13.469702 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f193e602-c910-4080-bcce-abccabd67067 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:13.470131 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f193e602-c910-4080-bcce-abccabd67067 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:13.470805 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f193e602-c910-4080-bcce-abccabd67067 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:13.471249 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f193e602-c910-4080-bcce-abccabd67067 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:13.471660 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-f193e602-c910-4080-bcce-abccabd67067 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:13.615109 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-f193e602-c910-4080-bcce-abccabd67067 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83076e7b11fb446ca50f23fe8e6e7ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a223be1c2f6a4cd281b20b0bc7281554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:05:13.622807 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-f193e602-c910-4080-bcce-abccabd67067 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] 10.222.0.59 "GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f" status: 200 len: 1574 microversion: 2.1 time: 0.164986 Aug 26 01:05:13.623363 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 532/1058] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:05:13 2022] GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f => generated 1574 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:05:14.643476 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-28fb4f12-1baa-4017-bc32-57842e391178 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:05:14.644093 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-28fb4f12-1baa-4017-bc32-57842e391178 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] [instance: d63711c4-8adf-43bd-9822-b8f82055f35f] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:05:14.650529 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-28fb4f12-1baa-4017-bc32-57842e391178 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:14.651017 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-28fb4f12-1baa-4017-bc32-57842e391178 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:14.651448 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-28fb4f12-1baa-4017-bc32-57842e391178 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:14.652142 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-28fb4f12-1baa-4017-bc32-57842e391178 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:14.652616 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-28fb4f12-1baa-4017-bc32-57842e391178 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:14.653211 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-28fb4f12-1baa-4017-bc32-57842e391178 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:14.785442 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-28fb4f12-1baa-4017-bc32-57842e391178 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83076e7b11fb446ca50f23fe8e6e7ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a223be1c2f6a4cd281b20b0bc7281554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:05:14.793441 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-28fb4f12-1baa-4017-bc32-57842e391178 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] 10.222.0.59 "GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f" status: 200 len: 1574 microversion: 2.1 time: 0.153865 Aug 26 01:05:14.794602 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 527/1059] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:05:14 2022] GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:05:15.814554 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-fa84f8c5-aab4-40ff-b8c2-97d798896e88 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:05:15.815413 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-fa84f8c5-aab4-40ff-b8c2-97d798896e88 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] [instance: d63711c4-8adf-43bd-9822-b8f82055f35f] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:05:15.821791 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fa84f8c5-aab4-40ff-b8c2-97d798896e88 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:15.822281 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fa84f8c5-aab4-40ff-b8c2-97d798896e88 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:15.822714 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fa84f8c5-aab4-40ff-b8c2-97d798896e88 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:15.823413 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fa84f8c5-aab4-40ff-b8c2-97d798896e88 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:15.823864 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fa84f8c5-aab4-40ff-b8c2-97d798896e88 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:15.824288 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fa84f8c5-aab4-40ff-b8c2-97d798896e88 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:15.962429 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-fa84f8c5-aab4-40ff-b8c2-97d798896e88 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83076e7b11fb446ca50f23fe8e6e7ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a223be1c2f6a4cd281b20b0bc7281554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:05:15.970826 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-fa84f8c5-aab4-40ff-b8c2-97d798896e88 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] 10.222.0.59 "GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f" status: 200 len: 1574 microversion: 2.1 time: 0.160082 Aug 26 01:05:15.971566 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 533/1060] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:05:15 2022] GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:05:15.973274 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [req-5b0c6786-9bcf-4f01-8321-cda968ca1f98 req-9309ae87-b02a-40c6-ba4f-6065ea5765e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d63711c4-8adf-43bd-9822-b8f82055f35f", "name": "network-vif-plugged", "status": "completed", "tag": "8d821bb5-fb83-42d7-b1c5-f97cf0d2ca3f"}]} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:05:15.983615 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-5b0c6786-9bcf-4f01-8321-cda968ca1f98 req-9309ae87-b02a-40c6-ba4f-6065ea5765e1 service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:15.984096 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-5b0c6786-9bcf-4f01-8321-cda968ca1f98 req-9309ae87-b02a-40c6-ba4f-6065ea5765e1 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:15.984551 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-5b0c6786-9bcf-4f01-8321-cda968ca1f98 req-9309ae87-b02a-40c6-ba4f-6065ea5765e1 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:15.995481 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.compute.server_external_events [req-5b0c6786-9bcf-4f01-8321-cda968ca1f98 req-9309ae87-b02a-40c6-ba4f-6065ea5765e1 service nova] Creating event network-vif-plugged:8d821bb5-fb83-42d7-b1c5-f97cf0d2ca3f for instance d63711c4-8adf-43bd-9822-b8f82055f35f on hv-cinder-83538 Aug 26 01:05:16.000742 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [req-5b0c6786-9bcf-4f01-8321-cda968ca1f98 req-9309ae87-b02a-40c6-ba4f-6065ea5765e1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031246 Aug 26 01:05:16.001327 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 528/1061] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 01:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:05:16.991131 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-55a75474-b9b2-403b-80b9-eb209763ffbb tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:05:16.991768 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-55a75474-b9b2-403b-80b9-eb209763ffbb tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] [instance: d63711c4-8adf-43bd-9822-b8f82055f35f] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:05:16.998852 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-55a75474-b9b2-403b-80b9-eb209763ffbb tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:16.999336 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-55a75474-b9b2-403b-80b9-eb209763ffbb tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:16.999770 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-55a75474-b9b2-403b-80b9-eb209763ffbb tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:17.000507 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-55a75474-b9b2-403b-80b9-eb209763ffbb tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:17.000968 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-55a75474-b9b2-403b-80b9-eb209763ffbb tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:17.001393 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-55a75474-b9b2-403b-80b9-eb209763ffbb tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:17.279947 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-55a75474-b9b2-403b-80b9-eb209763ffbb tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83076e7b11fb446ca50f23fe8e6e7ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a223be1c2f6a4cd281b20b0bc7281554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:05:17.288046 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-55a75474-b9b2-403b-80b9-eb209763ffbb tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] 10.222.0.59 "GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f" status: 200 len: 1574 microversion: 2.1 time: 0.300750 Aug 26 01:05:17.288616 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 534/1062] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:05:16 2022] GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f => generated 1574 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:05:18.309911 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-f6454794-fa7d-42be-8c9c-4b2301371fcd tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:05:18.310616 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-f6454794-fa7d-42be-8c9c-4b2301371fcd tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] [instance: d63711c4-8adf-43bd-9822-b8f82055f35f] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:05:18.316779 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f6454794-fa7d-42be-8c9c-4b2301371fcd tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:18.317262 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f6454794-fa7d-42be-8c9c-4b2301371fcd tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:18.317696 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f6454794-fa7d-42be-8c9c-4b2301371fcd tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:18.318385 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f6454794-fa7d-42be-8c9c-4b2301371fcd tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:18.318842 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f6454794-fa7d-42be-8c9c-4b2301371fcd tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:18.319269 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f6454794-fa7d-42be-8c9c-4b2301371fcd tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:18.449810 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-f6454794-fa7d-42be-8c9c-4b2301371fcd tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83076e7b11fb446ca50f23fe8e6e7ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a223be1c2f6a4cd281b20b0bc7281554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:05:18.458441 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-f6454794-fa7d-42be-8c9c-4b2301371fcd tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] 10.222.0.59 "GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f" status: 200 len: 1561 microversion: 2.1 time: 0.153357 Aug 26 01:05:18.459036 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 529/1063] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:05:18 2022] GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:05:22.135906 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-1aaebe52-bc13-4c51-80ab-7d99e0ae25c0 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:05:22.136627 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-1aaebe52-bc13-4c51-80ab-7d99e0ae25c0 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: 0d30e6dd-58a1-41b7-a675-5bfdb19e7415] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:05:22.143314 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1aaebe52-bc13-4c51-80ab-7d99e0ae25c0 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:22.143791 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1aaebe52-bc13-4c51-80ab-7d99e0ae25c0 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:22.144222 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1aaebe52-bc13-4c51-80ab-7d99e0ae25c0 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:22.144939 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1aaebe52-bc13-4c51-80ab-7d99e0ae25c0 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:22.145394 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1aaebe52-bc13-4c51-80ab-7d99e0ae25c0 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:22.145811 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1aaebe52-bc13-4c51-80ab-7d99e0ae25c0 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:22.168343 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-1aaebe52-bc13-4c51-80ab-7d99e0ae25c0 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/0d30e6dd-58a1-41b7-a675-5bfdb19e7415/ips" status: 200 len: 150 microversion: 2.1 time: 0.036837 Aug 26 01:05:22.168907 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 535/1064] 10.222.0.59 () {58 vars in 1248 bytes} [Fri Aug 26 01:05:22 2022] GET /compute/v2.1/servers/0d30e6dd-58a1-41b7-a675-5bfdb19e7415/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:05:23.785866 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-9153b16a-3164-4a12-ae3d-9c8c03deb6ac tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b05b4af9-8921-4ec2-ac95-2411e425f8fd"}} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:05:23.788450 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-9153b16a-3164-4a12-ae3d-9c8c03deb6ac tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: 0d30e6dd-58a1-41b7-a675-5bfdb19e7415] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:05:23.795022 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9153b16a-3164-4a12-ae3d-9c8c03deb6ac tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:23.795505 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9153b16a-3164-4a12-ae3d-9c8c03deb6ac tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:23.795944 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9153b16a-3164-4a12-ae3d-9c8c03deb6ac tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:23.796725 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9153b16a-3164-4a12-ae3d-9c8c03deb6ac tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:23.797179 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9153b16a-3164-4a12-ae3d-9c8c03deb6ac tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:23.797607 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9153b16a-3164-4a12-ae3d-9c8c03deb6ac tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:24.863785 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-9153b16a-3164-4a12-ae3d-9c8c03deb6ac tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "POST /compute/v2.1/servers/0d30e6dd-58a1-41b7-a675-5bfdb19e7415/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.081782 Aug 26 01:05:24.864495 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 530/1065] 10.222.0.59 () {60 vars in 1323 bytes} [Fri Aug 26 01:05:23 2022] POST /compute/v2.1/servers/0d30e6dd-58a1-41b7-a675-5bfdb19e7415/os-volume_attachments => generated 194 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:05:32.493685 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-35589438-7c29-4144-90c1-686f23062e75 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:05:32.494219 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-35589438-7c29-4144-90c1-686f23062e75 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: 0d30e6dd-58a1-41b7-a675-5bfdb19e7415] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:05:32.496627 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_api:SELECT=11 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:05:32.497288 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:05:32.502777 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-35589438-7c29-4144-90c1-686f23062e75 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:32.503269 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-35589438-7c29-4144-90c1-686f23062e75 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:32.503704 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-35589438-7c29-4144-90c1-686f23062e75 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:32.504392 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-35589438-7c29-4144-90c1-686f23062e75 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:32.504879 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-35589438-7c29-4144-90c1-686f23062e75 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:32.505305 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-35589438-7c29-4144-90c1-686f23062e75 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:32.585645 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.objects.instance [None req-35589438-7c29-4144-90c1-686f23062e75 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lazy-loading 'services' on Instance uuid 0d30e6dd-58a1-41b7-a675-5bfdb19e7415 {{(pid=127564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 01:05:32.779019 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-35589438-7c29-4144-90c1-686f23062e75 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "DELETE /compute/v2.1/servers/0d30e6dd-58a1-41b7-a675-5bfdb19e7415/os-volume_attachments/b05b4af9-8921-4ec2-ac95-2411e425f8fd" status: 202 len: 0 microversion: 2.1 time: 0.289088 Aug 26 01:05:32.779583 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 536/1066] 10.222.0.59 () {58 vars in 1416 bytes} [Fri Aug 26 01:05:32 2022] DELETE /compute/v2.1/servers/0d30e6dd-58a1-41b7-a675-5bfdb19e7415/os-volume_attachments/b05b4af9-8921-4ec2-ac95-2411e425f8fd => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 01:05:32.789877 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-41565eaa-4706-4fc4-bb8d-c369494a7708 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:05:32.792204 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-41565eaa-4706-4fc4-bb8d-c369494a7708 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: 0d30e6dd-58a1-41b7-a675-5bfdb19e7415] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:05:32.799878 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-41565eaa-4706-4fc4-bb8d-c369494a7708 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:32.800365 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-41565eaa-4706-4fc4-bb8d-c369494a7708 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:32.800840 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-41565eaa-4706-4fc4-bb8d-c369494a7708 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:32.801531 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-41565eaa-4706-4fc4-bb8d-c369494a7708 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:32.801981 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-41565eaa-4706-4fc4-bb8d-c369494a7708 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:32.802406 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-41565eaa-4706-4fc4-bb8d-c369494a7708 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:32.831305 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-41565eaa-4706-4fc4-bb8d-c369494a7708 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/0d30e6dd-58a1-41b7-a675-5bfdb19e7415/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046745 Aug 26 01:05:32.831878 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 531/1067] 10.222.0.59 () {58 vars in 1302 bytes} [Fri Aug 26 01:05:32 2022] GET /compute/v2.1/servers/0d30e6dd-58a1-41b7-a675-5bfdb19e7415/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:05:33.844374 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-ea662cdd-4ec1-4f79-af9f-b9bf34df7d30 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:05:33.846681 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-ea662cdd-4ec1-4f79-af9f-b9bf34df7d30 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: 0d30e6dd-58a1-41b7-a675-5bfdb19e7415] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:05:33.853485 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ea662cdd-4ec1-4f79-af9f-b9bf34df7d30 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:33.853964 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ea662cdd-4ec1-4f79-af9f-b9bf34df7d30 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:33.855148 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ea662cdd-4ec1-4f79-af9f-b9bf34df7d30 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:33.855148 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ea662cdd-4ec1-4f79-af9f-b9bf34df7d30 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:33.855552 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ea662cdd-4ec1-4f79-af9f-b9bf34df7d30 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:33.855972 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ea662cdd-4ec1-4f79-af9f-b9bf34df7d30 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:33.885975 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-ea662cdd-4ec1-4f79-af9f-b9bf34df7d30 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/0d30e6dd-58a1-41b7-a675-5bfdb19e7415/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046490 Aug 26 01:05:33.886521 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 537/1068] 10.222.0.59 () {58 vars in 1302 bytes} [Fri Aug 26 01:05:33 2022] GET /compute/v2.1/servers/0d30e6dd-58a1-41b7-a675-5bfdb19e7415/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:05:34.898944 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-644deeb5-9923-4f93-9399-8807f8dfdbdf tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:05:34.901153 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-644deeb5-9923-4f93-9399-8807f8dfdbdf tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: 0d30e6dd-58a1-41b7-a675-5bfdb19e7415] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:05:34.908320 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-644deeb5-9923-4f93-9399-8807f8dfdbdf tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:34.908835 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-644deeb5-9923-4f93-9399-8807f8dfdbdf tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:34.909276 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-644deeb5-9923-4f93-9399-8807f8dfdbdf tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:34.910000 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-644deeb5-9923-4f93-9399-8807f8dfdbdf tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:34.910452 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-644deeb5-9923-4f93-9399-8807f8dfdbdf tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:34.910877 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-644deeb5-9923-4f93-9399-8807f8dfdbdf tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:34.941758 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-644deeb5-9923-4f93-9399-8807f8dfdbdf tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/0d30e6dd-58a1-41b7-a675-5bfdb19e7415/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046823 Aug 26 01:05:34.942322 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 532/1069] 10.222.0.59 () {58 vars in 1302 bytes} [Fri Aug 26 01:05:34 2022] GET /compute/v2.1/servers/0d30e6dd-58a1-41b7-a675-5bfdb19e7415/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 01:05:35.002749 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-c92ba7dc-9e90-44d2-92e1-941c3450de61 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:05:35.003248 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-c92ba7dc-9e90-44d2-92e1-941c3450de61 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: 0d30e6dd-58a1-41b7-a675-5bfdb19e7415] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:05:35.009521 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c92ba7dc-9e90-44d2-92e1-941c3450de61 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:35.009999 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c92ba7dc-9e90-44d2-92e1-941c3450de61 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:35.010780 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c92ba7dc-9e90-44d2-92e1-941c3450de61 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:35.011135 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c92ba7dc-9e90-44d2-92e1-941c3450de61 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:35.011606 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c92ba7dc-9e90-44d2-92e1-941c3450de61 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:35.012038 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c92ba7dc-9e90-44d2-92e1-941c3450de61 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:35.037656 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-c92ba7dc-9e90-44d2-92e1-941c3450de61 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: 0d30e6dd-58a1-41b7-a675-5bfdb19e7415] Going to try to terminate instance {{(pid=127564) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 01:05:35.368088 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-c92ba7dc-9e90-44d2-92e1-941c3450de61 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "DELETE /compute/v2.1/servers/0d30e6dd-58a1-41b7-a675-5bfdb19e7415" status: 204 len: 0 microversion: 2.1 time: 0.368798 Aug 26 01:05:35.368701 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 538/1070] 10.222.0.59 () {58 vars in 1239 bytes} [Fri Aug 26 01:05:34 2022] DELETE /compute/v2.1/servers/0d30e6dd-58a1-41b7-a675-5bfdb19e7415 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 01:05:35.376930 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-9d9cad1b-e718-4090-97db-1f73589d2204 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:05:35.377549 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-9d9cad1b-e718-4090-97db-1f73589d2204 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: 0d30e6dd-58a1-41b7-a675-5bfdb19e7415] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:05:35.383434 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9d9cad1b-e718-4090-97db-1f73589d2204 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:35.383913 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9d9cad1b-e718-4090-97db-1f73589d2204 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:35.384349 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9d9cad1b-e718-4090-97db-1f73589d2204 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:35.385131 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9d9cad1b-e718-4090-97db-1f73589d2204 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:35.385584 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9d9cad1b-e718-4090-97db-1f73589d2204 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:35.386013 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9d9cad1b-e718-4090-97db-1f73589d2204 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:35.388663 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:05:35.520340 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-9d9cad1b-e718-4090-97db-1f73589d2204 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38047508b7d44f05af7116a15ba7e319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b021c415a147e08dbfede2ddc8cc27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:05:35.527895 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-9d9cad1b-e718-4090-97db-1f73589d2204 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/0d30e6dd-58a1-41b7-a675-5bfdb19e7415" status: 200 len: 1681 microversion: 2.1 time: 0.154860 Aug 26 01:05:35.528455 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 533/1071] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:05:35 2022] GET /compute/v2.1/servers/0d30e6dd-58a1-41b7-a675-5bfdb19e7415 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:05:36.550548 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-6068f735-e0a8-4553-b9bb-5a15a81398a3 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:05:36.551234 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-6068f735-e0a8-4553-b9bb-5a15a81398a3 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: 0d30e6dd-58a1-41b7-a675-5bfdb19e7415] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:05:36.557607 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6068f735-e0a8-4553-b9bb-5a15a81398a3 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:36.558081 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6068f735-e0a8-4553-b9bb-5a15a81398a3 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:36.558510 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6068f735-e0a8-4553-b9bb-5a15a81398a3 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:36.559189 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6068f735-e0a8-4553-b9bb-5a15a81398a3 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:36.559632 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6068f735-e0a8-4553-b9bb-5a15a81398a3 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:36.560050 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6068f735-e0a8-4553-b9bb-5a15a81398a3 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:36.686338 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-6068f735-e0a8-4553-b9bb-5a15a81398a3 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38047508b7d44f05af7116a15ba7e319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b021c415a147e08dbfede2ddc8cc27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:05:36.694034 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-6068f735-e0a8-4553-b9bb-5a15a81398a3 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/0d30e6dd-58a1-41b7-a675-5bfdb19e7415" status: 200 len: 1681 microversion: 2.1 time: 0.148193 Aug 26 01:05:36.694527 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 539/1072] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:05:36 2022] GET /compute/v2.1/servers/0d30e6dd-58a1-41b7-a675-5bfdb19e7415 => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:05:37.716054 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-ca0f2c16-0885-4f73-8444-5cdde03dbd41 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:05:37.716641 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-ca0f2c16-0885-4f73-8444-5cdde03dbd41 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: 0d30e6dd-58a1-41b7-a675-5bfdb19e7415] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:05:37.718996 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_api:SELECT=20 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:05:37.723827 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ca0f2c16-0885-4f73-8444-5cdde03dbd41 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:37.724311 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ca0f2c16-0885-4f73-8444-5cdde03dbd41 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:37.724787 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ca0f2c16-0885-4f73-8444-5cdde03dbd41 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:37.725483 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ca0f2c16-0885-4f73-8444-5cdde03dbd41 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:37.725969 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ca0f2c16-0885-4f73-8444-5cdde03dbd41 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:37.726361 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ca0f2c16-0885-4f73-8444-5cdde03dbd41 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:37.856793 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-ca0f2c16-0885-4f73-8444-5cdde03dbd41 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38047508b7d44f05af7116a15ba7e319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b021c415a147e08dbfede2ddc8cc27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:05:37.865124 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-ca0f2c16-0885-4f73-8444-5cdde03dbd41 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/0d30e6dd-58a1-41b7-a675-5bfdb19e7415" status: 200 len: 1681 microversion: 2.1 time: 0.153480 Aug 26 01:05:37.868873 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 534/1073] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:05:37 2022] GET /compute/v2.1/servers/0d30e6dd-58a1-41b7-a675-5bfdb19e7415 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:05:38.297385 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [req-7286cc2d-a77e-4fe6-8c7b-e1010ca5d62e req-6b1102fd-4caa-4a48-b89f-5f4d6cf0e6aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d30e6dd-58a1-41b7-a675-5bfdb19e7415", "name": "network-vif-deleted", "tag": "99c6fe4e-f024-4025-96b6-749ad0bc652c"}]} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:05:38.307809 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-7286cc2d-a77e-4fe6-8c7b-e1010ca5d62e req-6b1102fd-4caa-4a48-b89f-5f4d6cf0e6aa service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:38.308295 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-7286cc2d-a77e-4fe6-8c7b-e1010ca5d62e req-6b1102fd-4caa-4a48-b89f-5f4d6cf0e6aa service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:38.308778 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-7286cc2d-a77e-4fe6-8c7b-e1010ca5d62e req-6b1102fd-4caa-4a48-b89f-5f4d6cf0e6aa service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:38.323924 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.compute.server_external_events [req-7286cc2d-a77e-4fe6-8c7b-e1010ca5d62e req-6b1102fd-4caa-4a48-b89f-5f4d6cf0e6aa service nova] Creating event network-vif-deleted:99c6fe4e-f024-4025-96b6-749ad0bc652c for instance 0d30e6dd-58a1-41b7-a675-5bfdb19e7415 on hv-cinder-83538 Aug 26 01:05:38.330239 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [req-7286cc2d-a77e-4fe6-8c7b-e1010ca5d62e req-6b1102fd-4caa-4a48-b89f-5f4d6cf0e6aa service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037342 Aug 26 01:05:38.330829 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 540/1074] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 01:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:05:38.886184 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-d6273951-2107-4157-99c3-43354b2487ce tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:05:38.886816 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-d6273951-2107-4157-99c3-43354b2487ce tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: 0d30e6dd-58a1-41b7-a675-5bfdb19e7415] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:05:38.893939 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d6273951-2107-4157-99c3-43354b2487ce tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:38.894408 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d6273951-2107-4157-99c3-43354b2487ce tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:38.894844 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d6273951-2107-4157-99c3-43354b2487ce tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:38.895539 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d6273951-2107-4157-99c3-43354b2487ce tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:38.895992 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d6273951-2107-4157-99c3-43354b2487ce tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:38.896416 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d6273951-2107-4157-99c3-43354b2487ce tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:38.930023 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d6273951-2107-4157-99c3-43354b2487ce tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:38.930601 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d6273951-2107-4157-99c3-43354b2487ce tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:38.931042 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d6273951-2107-4157-99c3-43354b2487ce tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:38.931486 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.objects.instance [None req-d6273951-2107-4157-99c3-43354b2487ce tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lazy-loading 'fault' on Instance uuid 0d30e6dd-58a1-41b7-a675-5bfdb19e7415 {{(pid=127565) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 01:05:38.972377 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-d6273951-2107-4157-99c3-43354b2487ce tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38047508b7d44f05af7116a15ba7e319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b021c415a147e08dbfede2ddc8cc27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:05:38.980402 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-d6273951-2107-4157-99c3-43354b2487ce tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/0d30e6dd-58a1-41b7-a675-5bfdb19e7415" status: 200 len: 1330 microversion: 2.1 time: 0.098021 Aug 26 01:05:38.980997 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 535/1075] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:05:38 2022] GET /compute/v2.1/servers/0d30e6dd-58a1-41b7-a675-5bfdb19e7415 => generated 1330 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:05:40.002981 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-31b86ac0-ffda-4465-ac42-469f8f0f8246 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:05:40.003677 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-31b86ac0-ffda-4465-ac42-469f8f0f8246 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: 0d30e6dd-58a1-41b7-a675-5bfdb19e7415] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:05:40.009869 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-31b86ac0-ffda-4465-ac42-469f8f0f8246 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:40.010357 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-31b86ac0-ffda-4465-ac42-469f8f0f8246 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:40.010863 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-31b86ac0-ffda-4465-ac42-469f8f0f8246 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:40.011485 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-31b86ac0-ffda-4465-ac42-469f8f0f8246 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:40.011939 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-31b86ac0-ffda-4465-ac42-469f8f0f8246 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:40.012365 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-31b86ac0-ffda-4465-ac42-469f8f0f8246 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:40.025594 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.wsgi [None req-31b86ac0-ffda-4465-ac42-469f8f0f8246 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] HTTP exception thrown: Instance 0d30e6dd-58a1-41b7-a675-5bfdb19e7415 could not be found. Aug 26 01:05:40.027219 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-31b86ac0-ffda-4465-ac42-469f8f0f8246 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Request method failure captured: Aug 26 01:05:40.027219 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: request: GET /compute/v2.1/servers/0d30e6dd-58a1-41b7-a675-5bfdb19e7415 HTTP/1.1 Aug 26 01:05:40.027219 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Accept: application/json Aug 26 01:05:40.027219 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Accept-Encoding: identity Aug 26 01:05:40.027219 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Connection: close Aug 26 01:05:40.027219 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Content-Length: 0 Aug 26 01:05:40.027219 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Content-Type: application/json Aug 26 01:05:40.027219 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Host: 10.222.0.59 Aug 26 01:05:40.027219 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Openstack-System-Scope: None Aug 26 01:05:40.027219 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: User-Agent: python-urllib3/1.26.11 Aug 26 01:05:40.027219 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Auth-Token: gAAAAABjCBtKv7Ptmn6ODyXcqDwiO_uQzh6mqyqflGy1xdbBhbXPxieO4RSPPFbB4mQUaGf6pIM59uQGaWkpT_lu6RdlUkkLPi08g2IwRrKssv3K5sM8xJTV55LE3mg5hFUUhkTXeZla8aTh4ipX4VYHFhrTqhydw3qJT6H_hFgb5jrawb0wsSk Aug 26 01:05:40.027219 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Domain-Id: None Aug 26 01:05:40.027219 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Domain-Name: None Aug 26 01:05:40.027219 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Identity-Status: Confirmed Aug 26 01:05:40.027219 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Is-Admin-Project: True Aug 26 01:05:40.027219 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Domain-Id: default Aug 26 01:05:40.027219 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Domain-Name: Default Aug 26 01:05:40.027219 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Id: 03b021c415a147e08dbfede2ddc8cc27 Aug 26 01:05:40.027219 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Name: tempest-AttachVolumeNegativeTest-1692640927 Aug 26 01:05:40.027219 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Role: reader,member Aug 26 01:05:40.027219 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Roles: reader,member Aug 26 01:05:40.028965 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_03b021c415a147e08dbfede2ddc8cc27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/03b021c415a147e08dbfede2ddc8cc27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/03b021c415a147e08dbfede2ddc8cc27"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/03b021c415a147e08dbfede2ddc8cc27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 01:05:40.028965 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant: tempest-AttachVolumeNegativeTest-1692640927 Aug 26 01:05:40.028965 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant-Id: 03b021c415a147e08dbfede2ddc8cc27 Aug 26 01:05:40.028965 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1692640927 Aug 26 01:05:40.028965 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User: tempest-AttachVolumeNegativeTest-1692640927-project Aug 26 01:05:40.028965 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Domain-Id: default Aug 26 01:05:40.028965 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Domain-Name: Default Aug 26 01:05:40.028965 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Id: 38047508b7d44f05af7116a15ba7e319 Aug 26 01:05:40.028965 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Name: tempest-AttachVolumeNegativeTest-1692640927-project Aug 26 01:05:40.028965 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: method: > Aug 26 01:05:40.028965 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: exception: Instance 0d30e6dd-58a1-41b7-a675-5bfdb19e7415 could not be found. Aug 26 01:05:40.028965 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: action_args: {'id': '0d30e6dd-58a1-41b7-a675-5bfdb19e7415'} Aug 26 01:05:40.030170 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 01:05:40.030170 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:05:40.030170 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 01:05:40.030170 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 01:05:40.030170 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 01:05:40.030170 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 01:05:40.030170 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 01:05:40.030170 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 01:05:40.030170 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 01:05:40.030170 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 01:05:40.030170 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d30e6dd-58a1-41b7-a675-5bfdb19e7415 could not be found. Aug 26 01:05:40.030170 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:05:40.030170 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:05:40.030170 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:05:40.030170 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:05:40.030170 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:05:40.030170 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:05:40.030170 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 01:05:40.030170 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 01:05:40.030170 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 01:05:40.031791 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 01:05:40.031791 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 01:05:40.031791 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 01:05:40.031791 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 01:05:40.031791 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 01:05:40.031791 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 01:05:40.031791 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 01:05:40.031791 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d30e6dd-58a1-41b7-a675-5bfdb19e7415 could not be found. Aug 26 01:05:40.031791 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:05:40.031791 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:05:40.031791 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:05:40.031791 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:05:40.031791 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:05:40.031791 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:05:40.031791 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 01:05:40.031791 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 01:05:40.031791 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d30e6dd-58a1-41b7-a675-5bfdb19e7415 could not be found. Aug 26 01:05:40.031791 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:05:40.033372 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-31b86ac0-ffda-4465-ac42-469f8f0f8246 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Returning 404 to user: Instance 0d30e6dd-58a1-41b7-a675-5bfdb19e7415 could not be found. {{(pid=127564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 01:05:40.033372 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-31b86ac0-ffda-4465-ac42-469f8f0f8246 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/0d30e6dd-58a1-41b7-a675-5bfdb19e7415" status: 404 len: 111 microversion: 2.1 time: 0.030823 Aug 26 01:05:40.033372 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 541/1076] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:05:39 2022] GET /compute/v2.1/servers/0d30e6dd-58a1-41b7-a675-5bfdb19e7415 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 01:05:40.038231 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-7b2cff72-6587-4972-b1f4-8f711e0da87d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '.version_select at 0x7f8a92ef2160>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:05:40.117540 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-7b2cff72-6587-4972-b1f4-8f711e0da87d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-413191101" status: 202 len: 0 microversion: 2.1 time: 0.083403 Aug 26 01:05:40.118126 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 536/1077] 10.222.0.59 () {58 vars in 1218 bytes} [Fri Aug 26 01:05:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-413191101 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 01:05:42.229009 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-73571b72-a0c4-4299-8ee2-d1747996983d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:05:42.229499 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-73571b72-a0c4-4299-8ee2-d1747996983d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: 0d30e6dd-58a1-41b7-a675-5bfdb19e7415] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:05:42.236669 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-73571b72-a0c4-4299-8ee2-d1747996983d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:42.237146 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-73571b72-a0c4-4299-8ee2-d1747996983d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:42.237576 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-73571b72-a0c4-4299-8ee2-d1747996983d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:42.238256 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-73571b72-a0c4-4299-8ee2-d1747996983d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:42.238703 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-73571b72-a0c4-4299-8ee2-d1747996983d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:42.239120 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-73571b72-a0c4-4299-8ee2-d1747996983d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:42.252547 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.wsgi [None req-73571b72-a0c4-4299-8ee2-d1747996983d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] HTTP exception thrown: Instance 0d30e6dd-58a1-41b7-a675-5bfdb19e7415 could not be found. Aug 26 01:05:42.254082 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-73571b72-a0c4-4299-8ee2-d1747996983d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Request method failure captured: Aug 26 01:05:42.254082 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: request: DELETE /compute/v2.1/servers/0d30e6dd-58a1-41b7-a675-5bfdb19e7415 HTTP/1.1 Aug 26 01:05:42.254082 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Accept: application/json Aug 26 01:05:42.254082 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Accept-Encoding: identity Aug 26 01:05:42.254082 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Connection: close Aug 26 01:05:42.254082 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Content-Length: 0 Aug 26 01:05:42.254082 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Content-Type: application/json Aug 26 01:05:42.254082 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Host: 10.222.0.59 Aug 26 01:05:42.254082 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Openstack-System-Scope: None Aug 26 01:05:42.254082 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: User-Agent: python-urllib3/1.26.11 Aug 26 01:05:42.254082 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Auth-Token: gAAAAABjCBtKv7Ptmn6ODyXcqDwiO_uQzh6mqyqflGy1xdbBhbXPxieO4RSPPFbB4mQUaGf6pIM59uQGaWkpT_lu6RdlUkkLPi08g2IwRrKssv3K5sM8xJTV55LE3mg5hFUUhkTXeZla8aTh4ipX4VYHFhrTqhydw3qJT6H_hFgb5jrawb0wsSk Aug 26 01:05:42.254082 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Domain-Id: None Aug 26 01:05:42.254082 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Domain-Name: None Aug 26 01:05:42.254082 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Identity-Status: Confirmed Aug 26 01:05:42.254082 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Is-Admin-Project: True Aug 26 01:05:42.254082 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Domain-Id: default Aug 26 01:05:42.254082 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Domain-Name: Default Aug 26 01:05:42.254082 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Id: 03b021c415a147e08dbfede2ddc8cc27 Aug 26 01:05:42.254082 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Name: tempest-AttachVolumeNegativeTest-1692640927 Aug 26 01:05:42.254082 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Role: reader,member Aug 26 01:05:42.254082 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Roles: reader,member Aug 26 01:05:42.255779 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_03b021c415a147e08dbfede2ddc8cc27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/03b021c415a147e08dbfede2ddc8cc27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/03b021c415a147e08dbfede2ddc8cc27"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/03b021c415a147e08dbfede2ddc8cc27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 01:05:42.255779 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant: tempest-AttachVolumeNegativeTest-1692640927 Aug 26 01:05:42.255779 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant-Id: 03b021c415a147e08dbfede2ddc8cc27 Aug 26 01:05:42.255779 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1692640927 Aug 26 01:05:42.255779 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User: tempest-AttachVolumeNegativeTest-1692640927-project Aug 26 01:05:42.255779 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Domain-Id: default Aug 26 01:05:42.255779 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Domain-Name: Default Aug 26 01:05:42.255779 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Id: 38047508b7d44f05af7116a15ba7e319 Aug 26 01:05:42.255779 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Name: tempest-AttachVolumeNegativeTest-1692640927-project Aug 26 01:05:42.255779 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: method: > Aug 26 01:05:42.255779 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: exception: Instance 0d30e6dd-58a1-41b7-a675-5bfdb19e7415 could not be found. Aug 26 01:05:42.255779 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: action_args: {'id': '0d30e6dd-58a1-41b7-a675-5bfdb19e7415'} Aug 26 01:05:42.256829 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 01:05:42.256829 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:05:42.256829 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 01:05:42.256829 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 01:05:42.256829 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 01:05:42.256829 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 01:05:42.256829 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 01:05:42.256829 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 01:05:42.256829 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 01:05:42.256829 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 01:05:42.256829 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d30e6dd-58a1-41b7-a675-5bfdb19e7415 could not be found. Aug 26 01:05:42.256829 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:05:42.256829 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:05:42.256829 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:05:42.256829 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:05:42.256829 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:05:42.256829 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:05:42.256829 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 01:05:42.256829 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 01:05:42.256829 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 01:05:42.258358 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 01:05:42.258358 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 01:05:42.258358 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 01:05:42.258358 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 01:05:42.258358 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 01:05:42.258358 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 01:05:42.258358 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 01:05:42.258358 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 01:05:42.258358 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 01:05:42.258358 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d30e6dd-58a1-41b7-a675-5bfdb19e7415 could not be found. Aug 26 01:05:42.258358 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:05:42.258358 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:05:42.258358 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:05:42.258358 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:05:42.258358 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:05:42.258358 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:05:42.258358 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 01:05:42.258358 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 01:05:42.258358 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d30e6dd-58a1-41b7-a675-5bfdb19e7415 could not be found. Aug 26 01:05:42.258358 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:05:42.260146 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-73571b72-a0c4-4299-8ee2-d1747996983d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Returning 404 to user: Instance 0d30e6dd-58a1-41b7-a675-5bfdb19e7415 could not be found. {{(pid=127564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 01:05:42.260146 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-73571b72-a0c4-4299-8ee2-d1747996983d tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "DELETE /compute/v2.1/servers/0d30e6dd-58a1-41b7-a675-5bfdb19e7415" status: 404 len: 111 microversion: 2.1 time: 0.030220 Aug 26 01:05:42.260146 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 542/1078] 10.222.0.59 () {58 vars in 1239 bytes} [Fri Aug 26 01:05:42 2022] DELETE /compute/v2.1/servers/0d30e6dd-58a1-41b7-a675-5bfdb19e7415 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 01:05:42.264950 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-1f2ad53e-c4e2-48c4-a753-c03237f11a71 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:05:42.266100 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-1f2ad53e-c4e2-48c4-a753-c03237f11a71 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: 0d30e6dd-58a1-41b7-a675-5bfdb19e7415] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:05:42.273483 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1f2ad53e-c4e2-48c4-a753-c03237f11a71 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:42.274006 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1f2ad53e-c4e2-48c4-a753-c03237f11a71 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:42.274443 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1f2ad53e-c4e2-48c4-a753-c03237f11a71 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:42.275464 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1f2ad53e-c4e2-48c4-a753-c03237f11a71 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:42.275926 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1f2ad53e-c4e2-48c4-a753-c03237f11a71 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:42.276385 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1f2ad53e-c4e2-48c4-a753-c03237f11a71 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:42.292192 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.wsgi [None req-1f2ad53e-c4e2-48c4-a753-c03237f11a71 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] HTTP exception thrown: Instance 0d30e6dd-58a1-41b7-a675-5bfdb19e7415 could not be found. Aug 26 01:05:42.293963 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-1f2ad53e-c4e2-48c4-a753-c03237f11a71 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Request method failure captured: Aug 26 01:05:42.293963 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: request: GET /compute/v2.1/servers/0d30e6dd-58a1-41b7-a675-5bfdb19e7415 HTTP/1.1 Aug 26 01:05:42.293963 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Accept: application/json Aug 26 01:05:42.293963 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Accept-Encoding: identity Aug 26 01:05:42.293963 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Connection: close Aug 26 01:05:42.293963 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Content-Length: 0 Aug 26 01:05:42.293963 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Content-Type: application/json Aug 26 01:05:42.293963 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Host: 10.222.0.59 Aug 26 01:05:42.293963 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Openstack-System-Scope: None Aug 26 01:05:42.293963 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: User-Agent: python-urllib3/1.26.11 Aug 26 01:05:42.293963 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Auth-Token: gAAAAABjCBtKv7Ptmn6ODyXcqDwiO_uQzh6mqyqflGy1xdbBhbXPxieO4RSPPFbB4mQUaGf6pIM59uQGaWkpT_lu6RdlUkkLPi08g2IwRrKssv3K5sM8xJTV55LE3mg5hFUUhkTXeZla8aTh4ipX4VYHFhrTqhydw3qJT6H_hFgb5jrawb0wsSk Aug 26 01:05:42.293963 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Domain-Id: None Aug 26 01:05:42.293963 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Domain-Name: None Aug 26 01:05:42.293963 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Identity-Status: Confirmed Aug 26 01:05:42.293963 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Is-Admin-Project: True Aug 26 01:05:42.293963 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Domain-Id: default Aug 26 01:05:42.293963 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Domain-Name: Default Aug 26 01:05:42.293963 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Id: 03b021c415a147e08dbfede2ddc8cc27 Aug 26 01:05:42.293963 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Name: tempest-AttachVolumeNegativeTest-1692640927 Aug 26 01:05:42.293963 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Role: reader,member Aug 26 01:05:42.293963 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Roles: reader,member Aug 26 01:05:42.295612 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_03b021c415a147e08dbfede2ddc8cc27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/03b021c415a147e08dbfede2ddc8cc27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/03b021c415a147e08dbfede2ddc8cc27"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/03b021c415a147e08dbfede2ddc8cc27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 01:05:42.295612 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant: tempest-AttachVolumeNegativeTest-1692640927 Aug 26 01:05:42.295612 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant-Id: 03b021c415a147e08dbfede2ddc8cc27 Aug 26 01:05:42.295612 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1692640927 Aug 26 01:05:42.295612 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User: tempest-AttachVolumeNegativeTest-1692640927-project Aug 26 01:05:42.295612 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Domain-Id: default Aug 26 01:05:42.295612 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Domain-Name: Default Aug 26 01:05:42.295612 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Id: 38047508b7d44f05af7116a15ba7e319 Aug 26 01:05:42.295612 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Name: tempest-AttachVolumeNegativeTest-1692640927-project Aug 26 01:05:42.295612 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: method: > Aug 26 01:05:42.295612 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: exception: Instance 0d30e6dd-58a1-41b7-a675-5bfdb19e7415 could not be found. Aug 26 01:05:42.295612 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: action_args: {'id': '0d30e6dd-58a1-41b7-a675-5bfdb19e7415'} Aug 26 01:05:42.296570 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 01:05:42.296570 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:05:42.296570 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 01:05:42.296570 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 01:05:42.296570 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 01:05:42.296570 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 01:05:42.296570 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 01:05:42.296570 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 01:05:42.296570 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 01:05:42.296570 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 01:05:42.296570 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d30e6dd-58a1-41b7-a675-5bfdb19e7415 could not be found. Aug 26 01:05:42.296570 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:05:42.296570 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:05:42.296570 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:05:42.296570 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:05:42.296570 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:05:42.296570 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:05:42.296570 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 01:05:42.296570 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 01:05:42.296570 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 01:05:42.301769 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 01:05:42.301769 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 01:05:42.301769 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 01:05:42.301769 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 01:05:42.301769 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 01:05:42.301769 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 01:05:42.301769 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 01:05:42.301769 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d30e6dd-58a1-41b7-a675-5bfdb19e7415 could not be found. Aug 26 01:05:42.301769 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:05:42.301769 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:05:42.301769 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:05:42.301769 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:05:42.301769 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:05:42.301769 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:05:42.301769 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 01:05:42.301769 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 01:05:42.301769 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d30e6dd-58a1-41b7-a675-5bfdb19e7415 could not be found. Aug 26 01:05:42.301769 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:05:42.303160 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-1f2ad53e-c4e2-48c4-a753-c03237f11a71 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Returning 404 to user: Instance 0d30e6dd-58a1-41b7-a675-5bfdb19e7415 could not be found. {{(pid=127565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 01:05:42.303160 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-1f2ad53e-c4e2-48c4-a753-c03237f11a71 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/0d30e6dd-58a1-41b7-a675-5bfdb19e7415" status: 404 len: 111 microversion: 2.1 time: 0.035269 Aug 26 01:05:42.303160 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 537/1079] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:05:42 2022] GET /compute/v2.1/servers/0d30e6dd-58a1-41b7-a675-5bfdb19e7415 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 01:05:43.649915 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-c11c1d2e-c739-468c-b66e-8f64a5e05867 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:05:43.650409 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-c11c1d2e-c739-468c-b66e-8f64a5e05867 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: e5344f30-5e79-4f69-a954-d080b6b9f7ed] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:05:43.657864 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c11c1d2e-c739-468c-b66e-8f64a5e05867 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:43.658381 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c11c1d2e-c739-468c-b66e-8f64a5e05867 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:43.658855 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c11c1d2e-c739-468c-b66e-8f64a5e05867 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:43.659619 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c11c1d2e-c739-468c-b66e-8f64a5e05867 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:43.660112 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c11c1d2e-c739-468c-b66e-8f64a5e05867 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:43.660635 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-c11c1d2e-c739-468c-b66e-8f64a5e05867 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:43.680796 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.wsgi [None req-c11c1d2e-c739-468c-b66e-8f64a5e05867 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] HTTP exception thrown: Instance e5344f30-5e79-4f69-a954-d080b6b9f7ed could not be found. Aug 26 01:05:43.682489 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-c11c1d2e-c739-468c-b66e-8f64a5e05867 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Request method failure captured: Aug 26 01:05:43.682489 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: request: DELETE /compute/v2.1/servers/e5344f30-5e79-4f69-a954-d080b6b9f7ed HTTP/1.1 Aug 26 01:05:43.682489 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Accept: application/json Aug 26 01:05:43.682489 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Accept-Encoding: identity Aug 26 01:05:43.682489 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Connection: close Aug 26 01:05:43.682489 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Content-Length: 0 Aug 26 01:05:43.682489 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Content-Type: application/json Aug 26 01:05:43.682489 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Host: 10.222.0.59 Aug 26 01:05:43.682489 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Openstack-System-Scope: None Aug 26 01:05:43.682489 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: User-Agent: python-urllib3/1.26.11 Aug 26 01:05:43.682489 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Auth-Token: gAAAAABjCBtKv7Ptmn6ODyXcqDwiO_uQzh6mqyqflGy1xdbBhbXPxieO4RSPPFbB4mQUaGf6pIM59uQGaWkpT_lu6RdlUkkLPi08g2IwRrKssv3K5sM8xJTV55LE3mg5hFUUhkTXeZla8aTh4ipX4VYHFhrTqhydw3qJT6H_hFgb5jrawb0wsSk Aug 26 01:05:43.682489 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Domain-Id: None Aug 26 01:05:43.682489 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Domain-Name: None Aug 26 01:05:43.682489 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Identity-Status: Confirmed Aug 26 01:05:43.682489 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Is-Admin-Project: True Aug 26 01:05:43.682489 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Domain-Id: default Aug 26 01:05:43.682489 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Domain-Name: Default Aug 26 01:05:43.682489 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Id: 03b021c415a147e08dbfede2ddc8cc27 Aug 26 01:05:43.682489 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Name: tempest-AttachVolumeNegativeTest-1692640927 Aug 26 01:05:43.682489 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Role: reader,member Aug 26 01:05:43.682489 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Roles: reader,member Aug 26 01:05:43.684142 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_03b021c415a147e08dbfede2ddc8cc27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/03b021c415a147e08dbfede2ddc8cc27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/03b021c415a147e08dbfede2ddc8cc27"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/03b021c415a147e08dbfede2ddc8cc27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 01:05:43.684142 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant: tempest-AttachVolumeNegativeTest-1692640927 Aug 26 01:05:43.684142 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant-Id: 03b021c415a147e08dbfede2ddc8cc27 Aug 26 01:05:43.684142 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1692640927 Aug 26 01:05:43.684142 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User: tempest-AttachVolumeNegativeTest-1692640927-project Aug 26 01:05:43.684142 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Domain-Id: default Aug 26 01:05:43.684142 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Domain-Name: Default Aug 26 01:05:43.684142 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Id: 38047508b7d44f05af7116a15ba7e319 Aug 26 01:05:43.684142 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Name: tempest-AttachVolumeNegativeTest-1692640927-project Aug 26 01:05:43.684142 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: method: > Aug 26 01:05:43.684142 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: exception: Instance e5344f30-5e79-4f69-a954-d080b6b9f7ed could not be found. Aug 26 01:05:43.684142 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: action_args: {'id': 'e5344f30-5e79-4f69-a954-d080b6b9f7ed'} Aug 26 01:05:43.685113 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 01:05:43.685113 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:05:43.685113 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 01:05:43.685113 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 01:05:43.685113 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 01:05:43.685113 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 01:05:43.685113 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 01:05:43.685113 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 01:05:43.685113 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 01:05:43.685113 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 01:05:43.685113 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5344f30-5e79-4f69-a954-d080b6b9f7ed could not be found. Aug 26 01:05:43.685113 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:05:43.685113 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:05:43.685113 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:05:43.685113 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:05:43.685113 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:05:43.685113 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:05:43.685113 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 01:05:43.685113 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 01:05:43.685113 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 01:05:43.687219 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 01:05:43.687219 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 01:05:43.687219 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 01:05:43.687219 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 01:05:43.687219 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 01:05:43.687219 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 01:05:43.687219 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 01:05:43.687219 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 01:05:43.687219 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 01:05:43.687219 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5344f30-5e79-4f69-a954-d080b6b9f7ed could not be found. Aug 26 01:05:43.687219 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:05:43.687219 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:05:43.687219 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:05:43.687219 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:05:43.687219 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:05:43.687219 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:05:43.687219 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 01:05:43.687219 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 01:05:43.687219 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5344f30-5e79-4f69-a954-d080b6b9f7ed could not be found. Aug 26 01:05:43.687219 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:05:43.688890 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-c11c1d2e-c739-468c-b66e-8f64a5e05867 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Returning 404 to user: Instance e5344f30-5e79-4f69-a954-d080b6b9f7ed could not be found. {{(pid=127564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 01:05:43.688890 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-c11c1d2e-c739-468c-b66e-8f64a5e05867 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "DELETE /compute/v2.1/servers/e5344f30-5e79-4f69-a954-d080b6b9f7ed" status: 404 len: 111 microversion: 2.1 time: 0.037933 Aug 26 01:05:43.688890 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 543/1080] 10.222.0.59 () {58 vars in 1239 bytes} [Fri Aug 26 01:05:43 2022] DELETE /compute/v2.1/servers/e5344f30-5e79-4f69-a954-d080b6b9f7ed => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 01:05:43.693207 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-326fcb70-4374-404b-88ee-80b9798da116 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:05:43.693836 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-326fcb70-4374-404b-88ee-80b9798da116 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: e5344f30-5e79-4f69-a954-d080b6b9f7ed] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:05:43.704362 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-326fcb70-4374-404b-88ee-80b9798da116 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:43.705130 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-326fcb70-4374-404b-88ee-80b9798da116 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:43.705788 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-326fcb70-4374-404b-88ee-80b9798da116 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:43.706845 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-326fcb70-4374-404b-88ee-80b9798da116 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:43.707546 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-326fcb70-4374-404b-88ee-80b9798da116 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:43.708239 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-326fcb70-4374-404b-88ee-80b9798da116 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:43.730128 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.wsgi [None req-326fcb70-4374-404b-88ee-80b9798da116 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] HTTP exception thrown: Instance e5344f30-5e79-4f69-a954-d080b6b9f7ed could not be found. Aug 26 01:05:43.738450 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-326fcb70-4374-404b-88ee-80b9798da116 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Request method failure captured: Aug 26 01:05:43.738450 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: request: GET /compute/v2.1/servers/e5344f30-5e79-4f69-a954-d080b6b9f7ed HTTP/1.1 Aug 26 01:05:43.738450 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Accept: application/json Aug 26 01:05:43.738450 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Accept-Encoding: identity Aug 26 01:05:43.738450 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Connection: close Aug 26 01:05:43.738450 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Content-Length: 0 Aug 26 01:05:43.738450 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Content-Type: application/json Aug 26 01:05:43.738450 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Host: 10.222.0.59 Aug 26 01:05:43.738450 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Openstack-System-Scope: None Aug 26 01:05:43.738450 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: User-Agent: python-urllib3/1.26.11 Aug 26 01:05:43.738450 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Auth-Token: gAAAAABjCBtKv7Ptmn6ODyXcqDwiO_uQzh6mqyqflGy1xdbBhbXPxieO4RSPPFbB4mQUaGf6pIM59uQGaWkpT_lu6RdlUkkLPi08g2IwRrKssv3K5sM8xJTV55LE3mg5hFUUhkTXeZla8aTh4ipX4VYHFhrTqhydw3qJT6H_hFgb5jrawb0wsSk Aug 26 01:05:43.738450 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Domain-Id: None Aug 26 01:05:43.738450 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Domain-Name: None Aug 26 01:05:43.738450 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Identity-Status: Confirmed Aug 26 01:05:43.738450 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Is-Admin-Project: True Aug 26 01:05:43.738450 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Domain-Id: default Aug 26 01:05:43.738450 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Domain-Name: Default Aug 26 01:05:43.738450 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Id: 03b021c415a147e08dbfede2ddc8cc27 Aug 26 01:05:43.738450 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Name: tempest-AttachVolumeNegativeTest-1692640927 Aug 26 01:05:43.738450 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Role: reader,member Aug 26 01:05:43.738450 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Roles: reader,member Aug 26 01:05:43.740095 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_03b021c415a147e08dbfede2ddc8cc27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/03b021c415a147e08dbfede2ddc8cc27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/03b021c415a147e08dbfede2ddc8cc27"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/03b021c415a147e08dbfede2ddc8cc27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 01:05:43.740095 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant: tempest-AttachVolumeNegativeTest-1692640927 Aug 26 01:05:43.740095 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant-Id: 03b021c415a147e08dbfede2ddc8cc27 Aug 26 01:05:43.740095 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1692640927 Aug 26 01:05:43.740095 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User: tempest-AttachVolumeNegativeTest-1692640927-project Aug 26 01:05:43.740095 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Domain-Id: default Aug 26 01:05:43.740095 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Domain-Name: Default Aug 26 01:05:43.740095 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Id: 38047508b7d44f05af7116a15ba7e319 Aug 26 01:05:43.740095 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Name: tempest-AttachVolumeNegativeTest-1692640927-project Aug 26 01:05:43.740095 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: method: > Aug 26 01:05:43.740095 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: exception: Instance e5344f30-5e79-4f69-a954-d080b6b9f7ed could not be found. Aug 26 01:05:43.740095 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: action_args: {'id': 'e5344f30-5e79-4f69-a954-d080b6b9f7ed'} Aug 26 01:05:43.740973 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 01:05:43.740973 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:05:43.740973 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 01:05:43.740973 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 01:05:43.740973 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 01:05:43.740973 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 01:05:43.740973 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 01:05:43.740973 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 01:05:43.740973 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 01:05:43.740973 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 01:05:43.740973 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5344f30-5e79-4f69-a954-d080b6b9f7ed could not be found. Aug 26 01:05:43.740973 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:05:43.740973 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:05:43.740973 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:05:43.740973 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:05:43.740973 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:05:43.740973 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:05:43.740973 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 01:05:43.740973 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 01:05:43.740973 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 01:05:43.742795 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 01:05:43.742795 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 01:05:43.742795 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 01:05:43.742795 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 01:05:43.742795 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 01:05:43.742795 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 01:05:43.742795 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 01:05:43.742795 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5344f30-5e79-4f69-a954-d080b6b9f7ed could not be found. Aug 26 01:05:43.742795 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:05:43.742795 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:05:43.742795 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:05:43.742795 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:05:43.742795 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:05:43.742795 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:05:43.742795 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 01:05:43.742795 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 01:05:43.742795 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5344f30-5e79-4f69-a954-d080b6b9f7ed could not be found. Aug 26 01:05:43.742795 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:05:43.744261 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-326fcb70-4374-404b-88ee-80b9798da116 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Returning 404 to user: Instance e5344f30-5e79-4f69-a954-d080b6b9f7ed could not be found. {{(pid=127565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 01:05:43.744261 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-326fcb70-4374-404b-88ee-80b9798da116 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/e5344f30-5e79-4f69-a954-d080b6b9f7ed" status: 404 len: 111 microversion: 2.1 time: 0.051075 Aug 26 01:05:43.744261 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 538/1081] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:05:43 2022] GET /compute/v2.1/servers/e5344f30-5e79-4f69-a954-d080b6b9f7ed => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 01:05:43.751243 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-4fa5873d-07f6-408b-9ccd-79f26ad14a4f tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:05:43.751733 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-4fa5873d-07f6-408b-9ccd-79f26ad14a4f tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: 3955819b-d03a-4684-aba7-5d485c66a29e] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:05:43.759795 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-4fa5873d-07f6-408b-9ccd-79f26ad14a4f tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:43.760273 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-4fa5873d-07f6-408b-9ccd-79f26ad14a4f tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:43.760727 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-4fa5873d-07f6-408b-9ccd-79f26ad14a4f tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:43.761418 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-4fa5873d-07f6-408b-9ccd-79f26ad14a4f tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:43.761864 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-4fa5873d-07f6-408b-9ccd-79f26ad14a4f tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:43.762285 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-4fa5873d-07f6-408b-9ccd-79f26ad14a4f tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:43.776496 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.wsgi [None req-4fa5873d-07f6-408b-9ccd-79f26ad14a4f tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] HTTP exception thrown: Instance 3955819b-d03a-4684-aba7-5d485c66a29e could not be found. Aug 26 01:05:43.778045 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-4fa5873d-07f6-408b-9ccd-79f26ad14a4f tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Request method failure captured: Aug 26 01:05:43.778045 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: request: DELETE /compute/v2.1/servers/3955819b-d03a-4684-aba7-5d485c66a29e HTTP/1.1 Aug 26 01:05:43.778045 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Accept: application/json Aug 26 01:05:43.778045 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Accept-Encoding: identity Aug 26 01:05:43.778045 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Connection: close Aug 26 01:05:43.778045 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Content-Length: 0 Aug 26 01:05:43.778045 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Content-Type: application/json Aug 26 01:05:43.778045 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Host: 10.222.0.59 Aug 26 01:05:43.778045 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Openstack-System-Scope: None Aug 26 01:05:43.778045 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: User-Agent: python-urllib3/1.26.11 Aug 26 01:05:43.778045 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Auth-Token: gAAAAABjCBtKv7Ptmn6ODyXcqDwiO_uQzh6mqyqflGy1xdbBhbXPxieO4RSPPFbB4mQUaGf6pIM59uQGaWkpT_lu6RdlUkkLPi08g2IwRrKssv3K5sM8xJTV55LE3mg5hFUUhkTXeZla8aTh4ipX4VYHFhrTqhydw3qJT6H_hFgb5jrawb0wsSk Aug 26 01:05:43.778045 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Domain-Id: None Aug 26 01:05:43.778045 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Domain-Name: None Aug 26 01:05:43.778045 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Identity-Status: Confirmed Aug 26 01:05:43.778045 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Is-Admin-Project: True Aug 26 01:05:43.778045 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Domain-Id: default Aug 26 01:05:43.778045 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Domain-Name: Default Aug 26 01:05:43.778045 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Id: 03b021c415a147e08dbfede2ddc8cc27 Aug 26 01:05:43.778045 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Name: tempest-AttachVolumeNegativeTest-1692640927 Aug 26 01:05:43.778045 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Role: reader,member Aug 26 01:05:43.778045 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Roles: reader,member Aug 26 01:05:43.779834 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_03b021c415a147e08dbfede2ddc8cc27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/03b021c415a147e08dbfede2ddc8cc27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/03b021c415a147e08dbfede2ddc8cc27"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/03b021c415a147e08dbfede2ddc8cc27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 01:05:43.779834 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant: tempest-AttachVolumeNegativeTest-1692640927 Aug 26 01:05:43.779834 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant-Id: 03b021c415a147e08dbfede2ddc8cc27 Aug 26 01:05:43.779834 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1692640927 Aug 26 01:05:43.779834 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User: tempest-AttachVolumeNegativeTest-1692640927-project Aug 26 01:05:43.779834 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Domain-Id: default Aug 26 01:05:43.779834 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Domain-Name: Default Aug 26 01:05:43.779834 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Id: 38047508b7d44f05af7116a15ba7e319 Aug 26 01:05:43.779834 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Name: tempest-AttachVolumeNegativeTest-1692640927-project Aug 26 01:05:43.779834 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: method: > Aug 26 01:05:43.779834 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: exception: Instance 3955819b-d03a-4684-aba7-5d485c66a29e could not be found. Aug 26 01:05:43.779834 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: action_args: {'id': '3955819b-d03a-4684-aba7-5d485c66a29e'} Aug 26 01:05:43.781781 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 01:05:43.781781 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:05:43.781781 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 01:05:43.781781 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 01:05:43.781781 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 01:05:43.781781 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 01:05:43.781781 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 01:05:43.781781 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 01:05:43.781781 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 01:05:43.781781 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 01:05:43.781781 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3955819b-d03a-4684-aba7-5d485c66a29e could not be found. Aug 26 01:05:43.781781 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:05:43.781781 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:05:43.781781 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:05:43.781781 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:05:43.781781 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:05:43.781781 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:05:43.781781 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 01:05:43.781781 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 01:05:43.781781 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 01:05:43.784040 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 01:05:43.784040 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 01:05:43.784040 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 01:05:43.784040 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 01:05:43.784040 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 01:05:43.784040 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 01:05:43.784040 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 01:05:43.784040 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 01:05:43.784040 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 01:05:43.784040 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3955819b-d03a-4684-aba7-5d485c66a29e could not be found. Aug 26 01:05:43.784040 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:05:43.784040 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:05:43.784040 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:05:43.784040 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:05:43.784040 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:05:43.784040 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:05:43.784040 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 01:05:43.784040 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 01:05:43.784040 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3955819b-d03a-4684-aba7-5d485c66a29e could not be found. Aug 26 01:05:43.784040 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:05:43.785638 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-4fa5873d-07f6-408b-9ccd-79f26ad14a4f tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Returning 404 to user: Instance 3955819b-d03a-4684-aba7-5d485c66a29e could not be found. {{(pid=127564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 01:05:43.785638 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-4fa5873d-07f6-408b-9ccd-79f26ad14a4f tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "DELETE /compute/v2.1/servers/3955819b-d03a-4684-aba7-5d485c66a29e" status: 404 len: 111 microversion: 2.1 time: 0.032631 Aug 26 01:05:43.785638 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 544/1082] 10.222.0.59 () {58 vars in 1239 bytes} [Fri Aug 26 01:05:43 2022] DELETE /compute/v2.1/servers/3955819b-d03a-4684-aba7-5d485c66a29e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 01:05:43.788778 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-1051399d-d68c-4360-8b3e-e5dbf7ac6808 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:05:43.789397 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-1051399d-d68c-4360-8b3e-e5dbf7ac6808 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: 3955819b-d03a-4684-aba7-5d485c66a29e] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:05:43.796071 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1051399d-d68c-4360-8b3e-e5dbf7ac6808 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:43.796574 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1051399d-d68c-4360-8b3e-e5dbf7ac6808 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:43.797004 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1051399d-d68c-4360-8b3e-e5dbf7ac6808 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:43.797694 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1051399d-d68c-4360-8b3e-e5dbf7ac6808 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:43.798169 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1051399d-d68c-4360-8b3e-e5dbf7ac6808 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:43.798613 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-1051399d-d68c-4360-8b3e-e5dbf7ac6808 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:43.812907 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.wsgi [None req-1051399d-d68c-4360-8b3e-e5dbf7ac6808 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] HTTP exception thrown: Instance 3955819b-d03a-4684-aba7-5d485c66a29e could not be found. Aug 26 01:05:43.814481 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-1051399d-d68c-4360-8b3e-e5dbf7ac6808 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Request method failure captured: Aug 26 01:05:43.814481 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: request: GET /compute/v2.1/servers/3955819b-d03a-4684-aba7-5d485c66a29e HTTP/1.1 Aug 26 01:05:43.814481 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Accept: application/json Aug 26 01:05:43.814481 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Accept-Encoding: identity Aug 26 01:05:43.814481 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Connection: close Aug 26 01:05:43.814481 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Content-Length: 0 Aug 26 01:05:43.814481 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Content-Type: application/json Aug 26 01:05:43.814481 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Host: 10.222.0.59 Aug 26 01:05:43.814481 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Openstack-System-Scope: None Aug 26 01:05:43.814481 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: User-Agent: python-urllib3/1.26.11 Aug 26 01:05:43.814481 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Auth-Token: gAAAAABjCBtKv7Ptmn6ODyXcqDwiO_uQzh6mqyqflGy1xdbBhbXPxieO4RSPPFbB4mQUaGf6pIM59uQGaWkpT_lu6RdlUkkLPi08g2IwRrKssv3K5sM8xJTV55LE3mg5hFUUhkTXeZla8aTh4ipX4VYHFhrTqhydw3qJT6H_hFgb5jrawb0wsSk Aug 26 01:05:43.814481 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Domain-Id: None Aug 26 01:05:43.814481 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Domain-Name: None Aug 26 01:05:43.814481 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Identity-Status: Confirmed Aug 26 01:05:43.814481 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Is-Admin-Project: True Aug 26 01:05:43.814481 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Domain-Id: default Aug 26 01:05:43.814481 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Domain-Name: Default Aug 26 01:05:43.814481 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Id: 03b021c415a147e08dbfede2ddc8cc27 Aug 26 01:05:43.814481 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Name: tempest-AttachVolumeNegativeTest-1692640927 Aug 26 01:05:43.814481 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Role: reader,member Aug 26 01:05:43.814481 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Roles: reader,member Aug 26 01:05:43.816319 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_03b021c415a147e08dbfede2ddc8cc27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/03b021c415a147e08dbfede2ddc8cc27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/03b021c415a147e08dbfede2ddc8cc27"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/03b021c415a147e08dbfede2ddc8cc27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 01:05:43.816319 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant: tempest-AttachVolumeNegativeTest-1692640927 Aug 26 01:05:43.816319 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant-Id: 03b021c415a147e08dbfede2ddc8cc27 Aug 26 01:05:43.816319 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1692640927 Aug 26 01:05:43.816319 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User: tempest-AttachVolumeNegativeTest-1692640927-project Aug 26 01:05:43.816319 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Domain-Id: default Aug 26 01:05:43.816319 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Domain-Name: Default Aug 26 01:05:43.816319 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Id: 38047508b7d44f05af7116a15ba7e319 Aug 26 01:05:43.816319 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Name: tempest-AttachVolumeNegativeTest-1692640927-project Aug 26 01:05:43.816319 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: method: > Aug 26 01:05:43.816319 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: exception: Instance 3955819b-d03a-4684-aba7-5d485c66a29e could not be found. Aug 26 01:05:43.816319 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: action_args: {'id': '3955819b-d03a-4684-aba7-5d485c66a29e'} Aug 26 01:05:43.817367 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 01:05:43.817367 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:05:43.817367 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 01:05:43.817367 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 01:05:43.817367 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 01:05:43.817367 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 01:05:43.817367 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 01:05:43.817367 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 01:05:43.817367 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 01:05:43.817367 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 01:05:43.817367 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3955819b-d03a-4684-aba7-5d485c66a29e could not be found. Aug 26 01:05:43.817367 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:05:43.817367 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:05:43.817367 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:05:43.817367 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:05:43.817367 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:05:43.817367 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:05:43.817367 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 01:05:43.817367 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 01:05:43.817367 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 01:05:43.818912 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 01:05:43.818912 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 01:05:43.818912 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 01:05:43.818912 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 01:05:43.818912 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 01:05:43.818912 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 01:05:43.818912 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 01:05:43.818912 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3955819b-d03a-4684-aba7-5d485c66a29e could not be found. Aug 26 01:05:43.818912 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:05:43.818912 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:05:43.818912 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:05:43.818912 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:05:43.818912 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:05:43.818912 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:05:43.818912 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 01:05:43.818912 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 01:05:43.818912 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3955819b-d03a-4684-aba7-5d485c66a29e could not be found. Aug 26 01:05:43.818912 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:05:43.820435 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-1051399d-d68c-4360-8b3e-e5dbf7ac6808 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Returning 404 to user: Instance 3955819b-d03a-4684-aba7-5d485c66a29e could not be found. {{(pid=127565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 01:05:43.820435 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-1051399d-d68c-4360-8b3e-e5dbf7ac6808 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/3955819b-d03a-4684-aba7-5d485c66a29e" status: 404 len: 111 microversion: 2.1 time: 0.031294 Aug 26 01:05:43.820435 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 539/1083] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:05:43 2022] GET /compute/v2.1/servers/3955819b-d03a-4684-aba7-5d485c66a29e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 01:05:45.135982 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-5213618e-28bf-4728-a091-8a899dacd2b3 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:05:45.146470 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-5213618e-28bf-4728-a091-8a899dacd2b3 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: f432be84-f338-4303-86a0-a45611eb0850] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:05:45.146470 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5213618e-28bf-4728-a091-8a899dacd2b3 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:45.146470 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5213618e-28bf-4728-a091-8a899dacd2b3 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:45.146470 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5213618e-28bf-4728-a091-8a899dacd2b3 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:45.146930 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5213618e-28bf-4728-a091-8a899dacd2b3 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:45.146930 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5213618e-28bf-4728-a091-8a899dacd2b3 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:45.146930 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5213618e-28bf-4728-a091-8a899dacd2b3 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:45.160967 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.wsgi [None req-5213618e-28bf-4728-a091-8a899dacd2b3 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] HTTP exception thrown: Instance f432be84-f338-4303-86a0-a45611eb0850 could not be found. Aug 26 01:05:45.162774 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-5213618e-28bf-4728-a091-8a899dacd2b3 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Request method failure captured: Aug 26 01:05:45.162774 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: request: DELETE /compute/v2.1/servers/f432be84-f338-4303-86a0-a45611eb0850 HTTP/1.1 Aug 26 01:05:45.162774 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Accept: application/json Aug 26 01:05:45.162774 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Accept-Encoding: identity Aug 26 01:05:45.162774 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Connection: close Aug 26 01:05:45.162774 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Content-Length: 0 Aug 26 01:05:45.162774 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Content-Type: application/json Aug 26 01:05:45.162774 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Host: 10.222.0.59 Aug 26 01:05:45.162774 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Openstack-System-Scope: None Aug 26 01:05:45.162774 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: User-Agent: python-urllib3/1.26.11 Aug 26 01:05:45.162774 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Auth-Token: gAAAAABjCBtKv7Ptmn6ODyXcqDwiO_uQzh6mqyqflGy1xdbBhbXPxieO4RSPPFbB4mQUaGf6pIM59uQGaWkpT_lu6RdlUkkLPi08g2IwRrKssv3K5sM8xJTV55LE3mg5hFUUhkTXeZla8aTh4ipX4VYHFhrTqhydw3qJT6H_hFgb5jrawb0wsSk Aug 26 01:05:45.162774 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Domain-Id: None Aug 26 01:05:45.162774 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Domain-Name: None Aug 26 01:05:45.162774 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Identity-Status: Confirmed Aug 26 01:05:45.162774 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Is-Admin-Project: True Aug 26 01:05:45.162774 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Domain-Id: default Aug 26 01:05:45.162774 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Domain-Name: Default Aug 26 01:05:45.162774 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Id: 03b021c415a147e08dbfede2ddc8cc27 Aug 26 01:05:45.162774 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Name: tempest-AttachVolumeNegativeTest-1692640927 Aug 26 01:05:45.162774 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Role: reader,member Aug 26 01:05:45.162774 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Roles: reader,member Aug 26 01:05:45.164573 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_03b021c415a147e08dbfede2ddc8cc27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/03b021c415a147e08dbfede2ddc8cc27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/03b021c415a147e08dbfede2ddc8cc27"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/03b021c415a147e08dbfede2ddc8cc27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 01:05:45.164573 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant: tempest-AttachVolumeNegativeTest-1692640927 Aug 26 01:05:45.164573 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant-Id: 03b021c415a147e08dbfede2ddc8cc27 Aug 26 01:05:45.164573 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1692640927 Aug 26 01:05:45.164573 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User: tempest-AttachVolumeNegativeTest-1692640927-project Aug 26 01:05:45.164573 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Domain-Id: default Aug 26 01:05:45.164573 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Domain-Name: Default Aug 26 01:05:45.164573 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Id: 38047508b7d44f05af7116a15ba7e319 Aug 26 01:05:45.164573 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Name: tempest-AttachVolumeNegativeTest-1692640927-project Aug 26 01:05:45.164573 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: method: > Aug 26 01:05:45.164573 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: exception: Instance f432be84-f338-4303-86a0-a45611eb0850 could not be found. Aug 26 01:05:45.164573 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: action_args: {'id': 'f432be84-f338-4303-86a0-a45611eb0850'} Aug 26 01:05:45.165667 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 01:05:45.165667 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:05:45.165667 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 01:05:45.165667 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 01:05:45.165667 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 01:05:45.165667 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 01:05:45.165667 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 01:05:45.165667 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 01:05:45.165667 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 01:05:45.165667 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 01:05:45.165667 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f432be84-f338-4303-86a0-a45611eb0850 could not be found. Aug 26 01:05:45.165667 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:05:45.165667 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:05:45.165667 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:05:45.165667 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:05:45.165667 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:05:45.165667 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:05:45.165667 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 01:05:45.165667 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 01:05:45.165667 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 01:05:45.167392 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 01:05:45.167392 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 01:05:45.167392 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 01:05:45.167392 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 01:05:45.167392 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 01:05:45.167392 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 01:05:45.167392 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 01:05:45.167392 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 01:05:45.167392 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 01:05:45.167392 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f432be84-f338-4303-86a0-a45611eb0850 could not be found. Aug 26 01:05:45.167392 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:05:45.167392 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:05:45.167392 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:05:45.167392 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:05:45.167392 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:05:45.167392 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:05:45.167392 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 01:05:45.167392 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 01:05:45.167392 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f432be84-f338-4303-86a0-a45611eb0850 could not be found. Aug 26 01:05:45.167392 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:05:45.169090 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-5213618e-28bf-4728-a091-8a899dacd2b3 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Returning 404 to user: Instance f432be84-f338-4303-86a0-a45611eb0850 could not be found. {{(pid=127564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 01:05:45.169090 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-5213618e-28bf-4728-a091-8a899dacd2b3 tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "DELETE /compute/v2.1/servers/f432be84-f338-4303-86a0-a45611eb0850" status: 404 len: 111 microversion: 2.1 time: 0.033031 Aug 26 01:05:45.169090 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 545/1084] 10.222.0.59 () {58 vars in 1239 bytes} [Fri Aug 26 01:05:45 2022] DELETE /compute/v2.1/servers/f432be84-f338-4303-86a0-a45611eb0850 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 01:05:45.172855 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-809cb6a5-3b3e-4f51-9f80-4d37c292a09f tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:05:45.173625 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-809cb6a5-3b3e-4f51-9f80-4d37c292a09f tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] [instance: f432be84-f338-4303-86a0-a45611eb0850] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:05:45.180120 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-809cb6a5-3b3e-4f51-9f80-4d37c292a09f tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:45.180641 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-809cb6a5-3b3e-4f51-9f80-4d37c292a09f tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:45.181079 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-809cb6a5-3b3e-4f51-9f80-4d37c292a09f tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:45.181769 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-809cb6a5-3b3e-4f51-9f80-4d37c292a09f tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:05:45.182218 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-809cb6a5-3b3e-4f51-9f80-4d37c292a09f tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:05:45.182804 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-809cb6a5-3b3e-4f51-9f80-4d37c292a09f tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:05:45.196423 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.wsgi [None req-809cb6a5-3b3e-4f51-9f80-4d37c292a09f tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] HTTP exception thrown: Instance f432be84-f338-4303-86a0-a45611eb0850 could not be found. Aug 26 01:05:45.197971 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-809cb6a5-3b3e-4f51-9f80-4d37c292a09f tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Request method failure captured: Aug 26 01:05:45.197971 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: request: GET /compute/v2.1/servers/f432be84-f338-4303-86a0-a45611eb0850 HTTP/1.1 Aug 26 01:05:45.197971 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Accept: application/json Aug 26 01:05:45.197971 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Accept-Encoding: identity Aug 26 01:05:45.197971 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Connection: close Aug 26 01:05:45.197971 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Content-Length: 0 Aug 26 01:05:45.197971 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Content-Type: application/json Aug 26 01:05:45.197971 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Host: 10.222.0.59 Aug 26 01:05:45.197971 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Openstack-System-Scope: None Aug 26 01:05:45.197971 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: User-Agent: python-urllib3/1.26.11 Aug 26 01:05:45.197971 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Auth-Token: gAAAAABjCBtKv7Ptmn6ODyXcqDwiO_uQzh6mqyqflGy1xdbBhbXPxieO4RSPPFbB4mQUaGf6pIM59uQGaWkpT_lu6RdlUkkLPi08g2IwRrKssv3K5sM8xJTV55LE3mg5hFUUhkTXeZla8aTh4ipX4VYHFhrTqhydw3qJT6H_hFgb5jrawb0wsSk Aug 26 01:05:45.197971 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Domain-Id: None Aug 26 01:05:45.197971 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Domain-Name: None Aug 26 01:05:45.197971 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Identity-Status: Confirmed Aug 26 01:05:45.197971 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Is-Admin-Project: True Aug 26 01:05:45.197971 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Domain-Id: default Aug 26 01:05:45.197971 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Domain-Name: Default Aug 26 01:05:45.197971 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Id: 03b021c415a147e08dbfede2ddc8cc27 Aug 26 01:05:45.197971 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Name: tempest-AttachVolumeNegativeTest-1692640927 Aug 26 01:05:45.197971 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Role: reader,member Aug 26 01:05:45.197971 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Roles: reader,member Aug 26 01:05:45.199682 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_03b021c415a147e08dbfede2ddc8cc27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/03b021c415a147e08dbfede2ddc8cc27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/03b021c415a147e08dbfede2ddc8cc27"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/03b021c415a147e08dbfede2ddc8cc27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 01:05:45.199682 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant: tempest-AttachVolumeNegativeTest-1692640927 Aug 26 01:05:45.199682 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant-Id: 03b021c415a147e08dbfede2ddc8cc27 Aug 26 01:05:45.199682 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1692640927 Aug 26 01:05:45.199682 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User: tempest-AttachVolumeNegativeTest-1692640927-project Aug 26 01:05:45.199682 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Domain-Id: default Aug 26 01:05:45.199682 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Domain-Name: Default Aug 26 01:05:45.199682 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Id: 38047508b7d44f05af7116a15ba7e319 Aug 26 01:05:45.199682 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Name: tempest-AttachVolumeNegativeTest-1692640927-project Aug 26 01:05:45.199682 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: method: > Aug 26 01:05:45.199682 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: exception: Instance f432be84-f338-4303-86a0-a45611eb0850 could not be found. Aug 26 01:05:45.199682 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: action_args: {'id': 'f432be84-f338-4303-86a0-a45611eb0850'} Aug 26 01:05:45.200736 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 01:05:45.200736 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:05:45.200736 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 01:05:45.200736 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 01:05:45.200736 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 01:05:45.200736 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 01:05:45.200736 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 01:05:45.200736 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 01:05:45.200736 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 01:05:45.200736 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 01:05:45.200736 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f432be84-f338-4303-86a0-a45611eb0850 could not be found. Aug 26 01:05:45.200736 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:05:45.200736 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:05:45.200736 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:05:45.200736 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:05:45.200736 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:05:45.200736 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:05:45.200736 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 01:05:45.200736 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 01:05:45.200736 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 01:05:45.202813 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 01:05:45.202813 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 01:05:45.202813 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 01:05:45.202813 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 01:05:45.202813 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 01:05:45.202813 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 01:05:45.202813 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 01:05:45.202813 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f432be84-f338-4303-86a0-a45611eb0850 could not be found. Aug 26 01:05:45.202813 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:05:45.202813 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:05:45.202813 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:05:45.202813 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:05:45.202813 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:05:45.202813 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:05:45.202813 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 01:05:45.202813 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 01:05:45.202813 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f432be84-f338-4303-86a0-a45611eb0850 could not be found. Aug 26 01:05:45.202813 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:05:45.204258 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-809cb6a5-3b3e-4f51-9f80-4d37c292a09f tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] Returning 404 to user: Instance f432be84-f338-4303-86a0-a45611eb0850 could not be found. {{(pid=127565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 01:05:45.204258 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-809cb6a5-3b3e-4f51-9f80-4d37c292a09f tempest-AttachVolumeNegativeTest-1692640927 tempest-AttachVolumeNegativeTest-1692640927-project] 10.222.0.59 "GET /compute/v2.1/servers/f432be84-f338-4303-86a0-a45611eb0850" status: 404 len: 111 microversion: 2.1 time: 0.030385 Aug 26 01:05:45.204258 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 540/1085] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:05:45 2022] GET /compute/v2.1/servers/f432be84-f338-4303-86a0-a45611eb0850 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 01:06:33.823467 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-33c89053-a47f-489d-9a9c-703d4dfdaf1c tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:06:33.824029 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-33c89053-a47f-489d-9a9c-703d4dfdaf1c tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] [instance: d63711c4-8adf-43bd-9822-b8f82055f35f] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:06:33.825843 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [req-14f0228e-58ed-452b-b095-84219ed40f12 req-714b3b74-baf8-48f5-9295-46d07b90bacb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d63711c4-8adf-43bd-9822-b8f82055f35f", "tag": "8d821bb5-fb83-42d7-b1c5-f97cf0d2ca3f"}]} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:06:33.826382 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:06:33.827068 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:06:33.831104 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=1 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:06:33.831761 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell1:SELECT=27 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:06:33.832727 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-33c89053-a47f-489d-9a9c-703d4dfdaf1c tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:06:33.833312 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-33c89053-a47f-489d-9a9c-703d4dfdaf1c tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:06:33.833838 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-33c89053-a47f-489d-9a9c-703d4dfdaf1c tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:06:33.834630 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-33c89053-a47f-489d-9a9c-703d4dfdaf1c tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:06:33.835333 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-33c89053-a47f-489d-9a9c-703d4dfdaf1c tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:06:33.836107 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-33c89053-a47f-489d-9a9c-703d4dfdaf1c tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:06:33.837817 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-14f0228e-58ed-452b-b095-84219ed40f12 req-714b3b74-baf8-48f5-9295-46d07b90bacb service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:06:33.838535 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-14f0228e-58ed-452b-b095-84219ed40f12 req-714b3b74-baf8-48f5-9295-46d07b90bacb service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:06:33.838965 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-14f0228e-58ed-452b-b095-84219ed40f12 req-714b3b74-baf8-48f5-9295-46d07b90bacb service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:06:33.851391 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.compute.server_external_events [req-14f0228e-58ed-452b-b095-84219ed40f12 req-714b3b74-baf8-48f5-9295-46d07b90bacb service nova] Creating event network-changed:8d821bb5-fb83-42d7-b1c5-f97cf0d2ca3f for instance d63711c4-8adf-43bd-9822-b8f82055f35f on hv-cinder-83538 Aug 26 01:06:33.857411 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [req-14f0228e-58ed-452b-b095-84219ed40f12 req-714b3b74-baf8-48f5-9295-46d07b90bacb service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034671 Aug 26 01:06:33.858028 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 541/1086] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 01:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 01:06:33.866147 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-33c89053-a47f-489d-9a9c-703d4dfdaf1c tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] [instance: d63711c4-8adf-43bd-9822-b8f82055f35f] Going to try to terminate instance {{(pid=127564) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 01:06:34.150658 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-33c89053-a47f-489d-9a9c-703d4dfdaf1c tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] 10.222.0.59 "DELETE /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f" status: 204 len: 0 microversion: 2.1 time: 0.330978 Aug 26 01:06:34.151398 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 546/1087] 10.222.0.59 () {58 vars in 1239 bytes} [Fri Aug 26 01:06:33 2022] DELETE /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 01:06:34.161127 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-d3a06672-3539-4eff-9ddd-97bb8be4d8ea tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:06:34.162852 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-d3a06672-3539-4eff-9ddd-97bb8be4d8ea tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] [instance: d63711c4-8adf-43bd-9822-b8f82055f35f] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:06:34.172248 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d3a06672-3539-4eff-9ddd-97bb8be4d8ea tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:06:34.173010 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d3a06672-3539-4eff-9ddd-97bb8be4d8ea tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:06:34.173624 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d3a06672-3539-4eff-9ddd-97bb8be4d8ea tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:06:34.174556 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d3a06672-3539-4eff-9ddd-97bb8be4d8ea tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:06:34.175176 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d3a06672-3539-4eff-9ddd-97bb8be4d8ea tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:06:34.175899 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d3a06672-3539-4eff-9ddd-97bb8be4d8ea tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:06:34.610361 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-d3a06672-3539-4eff-9ddd-97bb8be4d8ea tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83076e7b11fb446ca50f23fe8e6e7ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a223be1c2f6a4cd281b20b0bc7281554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:06:34.619085 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-d3a06672-3539-4eff-9ddd-97bb8be4d8ea tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] 10.222.0.59 "GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f" status: 200 len: 1567 microversion: 2.1 time: 0.462460 Aug 26 01:06:34.619553 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 542/1088] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:06:34 2022] GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f => generated 1567 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:06:35.640391 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-8631b41d-07ff-40d3-a5dc-367a6f1c9146 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:06:35.641249 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-8631b41d-07ff-40d3-a5dc-367a6f1c9146 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] [instance: d63711c4-8adf-43bd-9822-b8f82055f35f] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:06:35.648511 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8631b41d-07ff-40d3-a5dc-367a6f1c9146 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:06:35.648999 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8631b41d-07ff-40d3-a5dc-367a6f1c9146 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:06:35.649656 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8631b41d-07ff-40d3-a5dc-367a6f1c9146 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:06:35.654604 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8631b41d-07ff-40d3-a5dc-367a6f1c9146 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:06:35.654604 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8631b41d-07ff-40d3-a5dc-367a6f1c9146 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:06:35.654604 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-8631b41d-07ff-40d3-a5dc-367a6f1c9146 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:06:35.808088 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-8631b41d-07ff-40d3-a5dc-367a6f1c9146 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83076e7b11fb446ca50f23fe8e6e7ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a223be1c2f6a4cd281b20b0bc7281554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:06:35.819276 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-8631b41d-07ff-40d3-a5dc-367a6f1c9146 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] 10.222.0.59 "GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f" status: 200 len: 1567 microversion: 2.1 time: 0.183984 Aug 26 01:06:35.821040 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 547/1089] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:06:35 2022] GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f => generated 1567 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:06:36.463149 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [req-7e1ffc49-800e-49b0-a0be-22afd0177a4c req-9746f073-b19d-4adc-85d9-0ebdc09cd994 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d63711c4-8adf-43bd-9822-b8f82055f35f", "name": "network-vif-deleted", "tag": "8d821bb5-fb83-42d7-b1c5-f97cf0d2ca3f"}]} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:06:36.474850 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-7e1ffc49-800e-49b0-a0be-22afd0177a4c req-9746f073-b19d-4adc-85d9-0ebdc09cd994 service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:06:36.478613 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-7e1ffc49-800e-49b0-a0be-22afd0177a4c req-9746f073-b19d-4adc-85d9-0ebdc09cd994 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:06:36.478613 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-7e1ffc49-800e-49b0-a0be-22afd0177a4c req-9746f073-b19d-4adc-85d9-0ebdc09cd994 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:06:36.489427 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.compute.server_external_events [req-7e1ffc49-800e-49b0-a0be-22afd0177a4c req-9746f073-b19d-4adc-85d9-0ebdc09cd994 service nova] Creating event network-vif-deleted:8d821bb5-fb83-42d7-b1c5-f97cf0d2ca3f for instance d63711c4-8adf-43bd-9822-b8f82055f35f on hv-cinder-83538 Aug 26 01:06:36.494724 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [req-7e1ffc49-800e-49b0-a0be-22afd0177a4c req-9746f073-b19d-4adc-85d9-0ebdc09cd994 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035458 Aug 26 01:06:36.495707 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 543/1090] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 01:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:06:36.843834 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-245b85c6-e354-4435-9d01-27882dca6588 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:06:36.844665 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-245b85c6-e354-4435-9d01-27882dca6588 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] [instance: d63711c4-8adf-43bd-9822-b8f82055f35f] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:06:36.851373 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-245b85c6-e354-4435-9d01-27882dca6588 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:06:36.852159 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-245b85c6-e354-4435-9d01-27882dca6588 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:06:36.852631 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-245b85c6-e354-4435-9d01-27882dca6588 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:06:36.853346 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-245b85c6-e354-4435-9d01-27882dca6588 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:06:36.853990 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-245b85c6-e354-4435-9d01-27882dca6588 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:06:36.854421 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-245b85c6-e354-4435-9d01-27882dca6588 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:06:36.922483 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-245b85c6-e354-4435-9d01-27882dca6588 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83076e7b11fb446ca50f23fe8e6e7ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a223be1c2f6a4cd281b20b0bc7281554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:06:36.940707 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-245b85c6-e354-4435-9d01-27882dca6588 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] 10.222.0.59 "GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f" status: 200 len: 1219 microversion: 2.1 time: 0.096041 Aug 26 01:06:36.940707 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 548/1091] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:06:36 2022] GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:06:37.960219 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-5940eaf8-4772-4314-8030-0cea02e6e8ef tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:06:37.960945 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-5940eaf8-4772-4314-8030-0cea02e6e8ef tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] [instance: d63711c4-8adf-43bd-9822-b8f82055f35f] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:06:37.968115 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5940eaf8-4772-4314-8030-0cea02e6e8ef tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:06:37.968646 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5940eaf8-4772-4314-8030-0cea02e6e8ef tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:06:37.969085 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5940eaf8-4772-4314-8030-0cea02e6e8ef tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:06:37.969788 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5940eaf8-4772-4314-8030-0cea02e6e8ef tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:06:37.970234 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5940eaf8-4772-4314-8030-0cea02e6e8ef tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:06:37.970654 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5940eaf8-4772-4314-8030-0cea02e6e8ef tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:06:38.003495 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5940eaf8-4772-4314-8030-0cea02e6e8ef tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:06:38.003986 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5940eaf8-4772-4314-8030-0cea02e6e8ef tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:06:38.004431 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5940eaf8-4772-4314-8030-0cea02e6e8ef tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:06:38.004911 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.objects.instance [None req-5940eaf8-4772-4314-8030-0cea02e6e8ef tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lazy-loading 'fault' on Instance uuid d63711c4-8adf-43bd-9822-b8f82055f35f {{(pid=127565) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 01:06:38.064413 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-5940eaf8-4772-4314-8030-0cea02e6e8ef tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83076e7b11fb446ca50f23fe8e6e7ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a223be1c2f6a4cd281b20b0bc7281554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:06:38.064413 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-5940eaf8-4772-4314-8030-0cea02e6e8ef tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] 10.222.0.59 "GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f" status: 200 len: 1224 microversion: 2.1 time: 0.101719 Aug 26 01:06:38.064413 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 544/1092] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:06:37 2022] GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f => generated 1224 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:06:39.079510 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-e8be0e56-f307-4407-8467-ce91d81931cc tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:06:39.080102 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-e8be0e56-f307-4407-8467-ce91d81931cc tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] [instance: d63711c4-8adf-43bd-9822-b8f82055f35f] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:06:39.086735 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e8be0e56-f307-4407-8467-ce91d81931cc tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:06:39.087990 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e8be0e56-f307-4407-8467-ce91d81931cc tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:06:39.088842 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e8be0e56-f307-4407-8467-ce91d81931cc tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:06:39.089550 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e8be0e56-f307-4407-8467-ce91d81931cc tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:06:39.090005 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e8be0e56-f307-4407-8467-ce91d81931cc tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:06:39.090607 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e8be0e56-f307-4407-8467-ce91d81931cc tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:06:39.105403 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.wsgi [None req-e8be0e56-f307-4407-8467-ce91d81931cc tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] HTTP exception thrown: Instance d63711c4-8adf-43bd-9822-b8f82055f35f could not be found. Aug 26 01:06:39.107105 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-e8be0e56-f307-4407-8467-ce91d81931cc tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Request method failure captured: Aug 26 01:06:39.107105 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: request: GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f HTTP/1.1 Aug 26 01:06:39.107105 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Accept: application/json Aug 26 01:06:39.107105 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Accept-Encoding: identity Aug 26 01:06:39.107105 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Connection: close Aug 26 01:06:39.107105 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Content-Length: 0 Aug 26 01:06:39.107105 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Content-Type: application/json Aug 26 01:06:39.107105 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Host: 10.222.0.59 Aug 26 01:06:39.107105 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Openstack-System-Scope: None Aug 26 01:06:39.107105 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: User-Agent: python-urllib3/1.26.11 Aug 26 01:06:39.107105 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Auth-Token: gAAAAABjCBuIIKNoHV13DoxNh-d6bB5wsL7ycsgOG9JBNwsYyrESOAd51RehDx-MuvpVcSMKu0NvYJsJOx_Z05dmoTznTdX6uS4lVSeEEs5Sv9Ui08cGseezmYoymB0DDpL0wJAA2hAjAl3dJzAWlGlH_5533UWxdjaCAx17vmaYc9NAQymLFEo Aug 26 01:06:39.107105 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Domain-Id: None Aug 26 01:06:39.107105 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Domain-Name: None Aug 26 01:06:39.107105 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Identity-Status: Confirmed Aug 26 01:06:39.107105 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Is-Admin-Project: True Aug 26 01:06:39.107105 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Domain-Id: default Aug 26 01:06:39.107105 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Domain-Name: Default Aug 26 01:06:39.107105 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Id: a223be1c2f6a4cd281b20b0bc7281554 Aug 26 01:06:39.107105 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Name: tempest-TestShelveInstance-1217773634 Aug 26 01:06:39.107105 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Role: reader,member Aug 26 01:06:39.107105 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Roles: reader,member Aug 26 01:06:39.108967 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_a223be1c2f6a4cd281b20b0bc7281554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a223be1c2f6a4cd281b20b0bc7281554"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a223be1c2f6a4cd281b20b0bc7281554"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/a223be1c2f6a4cd281b20b0bc7281554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 01:06:39.108967 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant: tempest-TestShelveInstance-1217773634 Aug 26 01:06:39.108967 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant-Id: a223be1c2f6a4cd281b20b0bc7281554 Aug 26 01:06:39.108967 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant-Name: tempest-TestShelveInstance-1217773634 Aug 26 01:06:39.108967 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User: tempest-TestShelveInstance-1217773634-project Aug 26 01:06:39.108967 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Domain-Id: default Aug 26 01:06:39.108967 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Domain-Name: Default Aug 26 01:06:39.108967 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Id: 83076e7b11fb446ca50f23fe8e6e7ab6 Aug 26 01:06:39.108967 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Name: tempest-TestShelveInstance-1217773634-project Aug 26 01:06:39.108967 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: method: > Aug 26 01:06:39.108967 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: exception: Instance d63711c4-8adf-43bd-9822-b8f82055f35f could not be found. Aug 26 01:06:39.108967 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: action_args: {'id': 'd63711c4-8adf-43bd-9822-b8f82055f35f'} Aug 26 01:06:39.110094 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 01:06:39.110094 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:06:39.110094 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 01:06:39.110094 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 01:06:39.110094 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 01:06:39.110094 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 01:06:39.110094 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 01:06:39.110094 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 01:06:39.110094 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 01:06:39.110094 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 01:06:39.110094 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d63711c4-8adf-43bd-9822-b8f82055f35f could not be found. Aug 26 01:06:39.110094 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:06:39.110094 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:06:39.110094 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:06:39.110094 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:06:39.110094 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:06:39.110094 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:06:39.110094 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 01:06:39.110094 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 01:06:39.110094 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 01:06:39.111854 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 01:06:39.111854 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 01:06:39.111854 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 01:06:39.111854 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 01:06:39.111854 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 01:06:39.111854 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 01:06:39.111854 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 01:06:39.111854 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d63711c4-8adf-43bd-9822-b8f82055f35f could not be found. Aug 26 01:06:39.111854 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:06:39.111854 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:06:39.111854 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:06:39.111854 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:06:39.111854 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:06:39.111854 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:06:39.111854 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 01:06:39.111854 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 01:06:39.111854 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d63711c4-8adf-43bd-9822-b8f82055f35f could not be found. Aug 26 01:06:39.111854 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:06:39.113352 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-e8be0e56-f307-4407-8467-ce91d81931cc tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Returning 404 to user: Instance d63711c4-8adf-43bd-9822-b8f82055f35f could not be found. {{(pid=127564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 01:06:39.113352 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-e8be0e56-f307-4407-8467-ce91d81931cc tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] 10.222.0.59 "GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f" status: 404 len: 111 microversion: 2.1 time: 0.033392 Aug 26 01:06:39.113352 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 549/1093] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:06:39 2022] GET /compute/v2.1/servers/d63711c4-8adf-43bd-9822-b8f82055f35f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 01:06:39.669532 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-1c98d8ff-1f95-4d4b-8ad2-505c39c7f8a2 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] Calling method '.version_select at 0x7f8a92ddaf70>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:06:39.830784 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-1c98d8ff-1f95-4d4b-8ad2-505c39c7f8a2 tempest-TestShelveInstance-1217773634 tempest-TestShelveInstance-1217773634-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1155807456" status: 202 len: 0 microversion: 2.1 time: 0.165802 Aug 26 01:06:39.831378 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 545/1094] 10.222.0.59 () {58 vars in 1254 bytes} [Fri Aug 26 01:06:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1155807456 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 01:06:42.728448 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-5b9a2b1a-34b2-40fb-86cc-339a5a7b2a06 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-580133252", "imageRef": "ef60327f-6e0c-4f85-8db9-6f6e8968fe9c", "flavorRef": "452", "networks": [{"uuid": "a8f76b0c-a13d-4adf-aac7-f2a0a3c67769"}]}} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:06:42.791031 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.network.neutron [None req-5b9a2b1a-34b2-40fb-86cc-339a5a7b2a06 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] validate_networks() for [('a8f76b0c-a13d-4adf-aac7-f2a0a3c67769', None, None, None, None, None)] {{(pid=127564) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 01:06:43.263155 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.virt.hardware [None req-5b9a2b1a-34b2-40fb-86cc-339a5a7b2a06 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Flavor limits 0:0:0 {{(pid=127564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 01:06:43.263155 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.virt.hardware [None req-5b9a2b1a-34b2-40fb-86cc-339a5a7b2a06 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Image limits 0:0:0 {{(pid=127564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 01:06:43.263155 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.virt.hardware [None req-5b9a2b1a-34b2-40fb-86cc-339a5a7b2a06 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Flavor pref 0:0:0 {{(pid=127564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 01:06:43.263155 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.virt.hardware [None req-5b9a2b1a-34b2-40fb-86cc-339a5a7b2a06 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Image pref 0:0:0 {{(pid=127564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 01:06:43.263155 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.virt.hardware [None req-5b9a2b1a-34b2-40fb-86cc-339a5a7b2a06 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 01:06:43.267530 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5b9a2b1a-34b2-40fb-86cc-339a5a7b2a06 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:06:43.268007 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5b9a2b1a-34b2-40fb-86cc-339a5a7b2a06 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:06:43.268438 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5b9a2b1a-34b2-40fb-86cc-339a5a7b2a06 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:06:43.269198 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5b9a2b1a-34b2-40fb-86cc-339a5a7b2a06 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:06:43.269645 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5b9a2b1a-34b2-40fb-86cc-339a5a7b2a06 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:06:43.270563 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5b9a2b1a-34b2-40fb-86cc-339a5a7b2a06 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:06:43.287974 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.quota [None req-5b9a2b1a-34b2-40fb-86cc-339a5a7b2a06 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Getting quotas for project 0f048337938642b2bf9165db865e8edb. Resources: {'instances', 'ram', 'cores'} {{(pid=127564) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 01:06:43.291987 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.quota [None req-5b9a2b1a-34b2-40fb-86cc-339a5a7b2a06 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Getting quotas for user a4b35218c0034a58bf245444b877ff8e and project 0f048337938642b2bf9165db865e8edb. Resources: {'instances', 'ram', 'cores'} {{(pid=127564) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 01:06:43.303313 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-5b9a2b1a-34b2-40fb-86cc-339a5a7b2a06 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Going to run 1 instances... {{(pid=127564) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 01:06:43.305585 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-5b9a2b1a-34b2-40fb-86cc-339a5a7b2a06 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] [instance: 68102332-bfa3-42b5-b3ef-5840bb67b860] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ef60327f-6e0c-4f85-8db9-6f6e8968fe9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 01:06:43.406286 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-5b9a2b1a-34b2-40fb-86cc-339a5a7b2a06 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.682834 Aug 26 01:06:43.409800 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 550/1095] 10.222.0.59 () {60 vars in 1147 bytes} [Fri Aug 26 01:06:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 26 01:06:43.422078 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-602fc657-c6fe-48c5-9b59-70ecd592a6eb tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:06:43.435633 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-602fc657-c6fe-48c5-9b59-70ecd592a6eb tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] [instance: 68102332-bfa3-42b5-b3ef-5840bb67b860] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:06:43.505156 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-602fc657-c6fe-48c5-9b59-70ecd592a6eb tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b35218c0034a58bf245444b877ff8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f048337938642b2bf9165db865e8edb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:06:43.513121 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-602fc657-c6fe-48c5-9b59-70ecd592a6eb tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] 10.222.0.59 "GET /compute/v2.1/servers/68102332-bfa3-42b5-b3ef-5840bb67b860" status: 200 len: 1218 microversion: 2.1 time: 0.095713 Aug 26 01:06:43.513874 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 546/1096] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:06:43 2022] GET /compute/v2.1/servers/68102332-bfa3-42b5-b3ef-5840bb67b860 => generated 1218 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:06:44.532841 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-9b2c93cb-e26d-4a51-86a4-bdb3c6cc077e tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:06:44.533400 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-9b2c93cb-e26d-4a51-86a4-bdb3c6cc077e tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] [instance: 68102332-bfa3-42b5-b3ef-5840bb67b860] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:06:44.597317 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-9b2c93cb-e26d-4a51-86a4-bdb3c6cc077e tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b35218c0034a58bf245444b877ff8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f048337938642b2bf9165db865e8edb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:06:44.604100 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-9b2c93cb-e26d-4a51-86a4-bdb3c6cc077e tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] 10.222.0.59 "GET /compute/v2.1/servers/68102332-bfa3-42b5-b3ef-5840bb67b860" status: 200 len: 1218 microversion: 2.1 time: 0.075389 Aug 26 01:06:44.604693 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 551/1097] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:06:44 2022] GET /compute/v2.1/servers/68102332-bfa3-42b5-b3ef-5840bb67b860 => generated 1218 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:06:45.627029 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-60c6c166-0493-45eb-92bd-35c95c04ae96 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:06:45.628433 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-60c6c166-0493-45eb-92bd-35c95c04ae96 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] [instance: 68102332-bfa3-42b5-b3ef-5840bb67b860] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:06:45.635935 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-60c6c166-0493-45eb-92bd-35c95c04ae96 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:06:45.636608 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-60c6c166-0493-45eb-92bd-35c95c04ae96 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:06:45.637242 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-60c6c166-0493-45eb-92bd-35c95c04ae96 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:06:45.638639 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-60c6c166-0493-45eb-92bd-35c95c04ae96 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:06:45.639205 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-60c6c166-0493-45eb-92bd-35c95c04ae96 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:06:45.639735 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-60c6c166-0493-45eb-92bd-35c95c04ae96 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:06:45.990831 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-60c6c166-0493-45eb-92bd-35c95c04ae96 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b35218c0034a58bf245444b877ff8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f048337938642b2bf9165db865e8edb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:06:46.000979 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-60c6c166-0493-45eb-92bd-35c95c04ae96 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] 10.222.0.59 "GET /compute/v2.1/servers/68102332-bfa3-42b5-b3ef-5840bb67b860" status: 200 len: 1270 microversion: 2.1 time: 0.379417 Aug 26 01:06:46.001564 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 547/1098] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:06:45 2022] GET /compute/v2.1/servers/68102332-bfa3-42b5-b3ef-5840bb67b860 => generated 1270 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 01:06:47.022214 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-e3e2107f-46b9-4b3c-94c5-c19a297c3f43 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:06:47.022962 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-e3e2107f-46b9-4b3c-94c5-c19a297c3f43 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] [instance: 68102332-bfa3-42b5-b3ef-5840bb67b860] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:06:47.030132 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e3e2107f-46b9-4b3c-94c5-c19a297c3f43 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:06:47.030616 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e3e2107f-46b9-4b3c-94c5-c19a297c3f43 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:06:47.031051 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e3e2107f-46b9-4b3c-94c5-c19a297c3f43 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:06:47.031745 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e3e2107f-46b9-4b3c-94c5-c19a297c3f43 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:06:47.032198 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e3e2107f-46b9-4b3c-94c5-c19a297c3f43 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:06:47.032752 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e3e2107f-46b9-4b3c-94c5-c19a297c3f43 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:06:47.147804 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-e3e2107f-46b9-4b3c-94c5-c19a297c3f43 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b35218c0034a58bf245444b877ff8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f048337938642b2bf9165db865e8edb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:06:47.157975 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-e3e2107f-46b9-4b3c-94c5-c19a297c3f43 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] 10.222.0.59 "GET /compute/v2.1/servers/68102332-bfa3-42b5-b3ef-5840bb67b860" status: 200 len: 1276 microversion: 2.1 time: 0.139637 Aug 26 01:06:47.169505 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 552/1099] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:06:47 2022] GET /compute/v2.1/servers/68102332-bfa3-42b5-b3ef-5840bb67b860 => generated 1276 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 01:06:48.181199 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-e33ef26a-ff31-4307-aa67-5afffa511729 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:06:48.181796 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-e33ef26a-ff31-4307-aa67-5afffa511729 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] [instance: 68102332-bfa3-42b5-b3ef-5840bb67b860] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:06:48.188438 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e33ef26a-ff31-4307-aa67-5afffa511729 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:06:48.193555 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e33ef26a-ff31-4307-aa67-5afffa511729 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:06:48.193555 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e33ef26a-ff31-4307-aa67-5afffa511729 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:06:48.193555 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e33ef26a-ff31-4307-aa67-5afffa511729 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:06:48.193555 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e33ef26a-ff31-4307-aa67-5afffa511729 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:06:48.193980 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-e33ef26a-ff31-4307-aa67-5afffa511729 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:06:48.293844 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [req-ecfafa42-9c13-4c36-b74f-06b4bf7ac827 req-935842e3-adb1-452b-b80a-b909f126ff20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68102332-bfa3-42b5-b3ef-5840bb67b860", "tag": "17261063-b975-4e59-996d-2843228e8416"}]} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:06:48.305634 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-ecfafa42-9c13-4c36-b74f-06b4bf7ac827 req-935842e3-adb1-452b-b80a-b909f126ff20 service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:06:48.307803 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-ecfafa42-9c13-4c36-b74f-06b4bf7ac827 req-935842e3-adb1-452b-b80a-b909f126ff20 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:06:48.308433 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-ecfafa42-9c13-4c36-b74f-06b4bf7ac827 req-935842e3-adb1-452b-b80a-b909f126ff20 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:06:48.320345 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.compute.server_external_events [req-ecfafa42-9c13-4c36-b74f-06b4bf7ac827 req-935842e3-adb1-452b-b80a-b909f126ff20 service nova] Creating event network-changed:17261063-b975-4e59-996d-2843228e8416 for instance 68102332-bfa3-42b5-b3ef-5840bb67b860 on hv-cinder-83538 Aug 26 01:06:48.325918 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [req-ecfafa42-9c13-4c36-b74f-06b4bf7ac827 req-935842e3-adb1-452b-b80a-b909f126ff20 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038019 Aug 26 01:06:48.327022 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 553/1100] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 01:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:06:48.360233 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-e33ef26a-ff31-4307-aa67-5afffa511729 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b35218c0034a58bf245444b877ff8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f048337938642b2bf9165db865e8edb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:06:48.370202 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-e33ef26a-ff31-4307-aa67-5afffa511729 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] 10.222.0.59 "GET /compute/v2.1/servers/68102332-bfa3-42b5-b3ef-5840bb67b860" status: 200 len: 1318 microversion: 2.1 time: 0.192797 Aug 26 01:06:48.371239 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 548/1101] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:06:48 2022] GET /compute/v2.1/servers/68102332-bfa3-42b5-b3ef-5840bb67b860 => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:06:49.393040 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-0ba5fb3a-8071-4a1b-8e9c-583025c08745 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:06:49.393852 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-0ba5fb3a-8071-4a1b-8e9c-583025c08745 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] [instance: 68102332-bfa3-42b5-b3ef-5840bb67b860] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:06:49.400425 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-0ba5fb3a-8071-4a1b-8e9c-583025c08745 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:06:49.401014 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-0ba5fb3a-8071-4a1b-8e9c-583025c08745 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:06:49.401525 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-0ba5fb3a-8071-4a1b-8e9c-583025c08745 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:06:49.402299 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-0ba5fb3a-8071-4a1b-8e9c-583025c08745 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:06:49.403028 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-0ba5fb3a-8071-4a1b-8e9c-583025c08745 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:06:49.403546 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-0ba5fb3a-8071-4a1b-8e9c-583025c08745 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:06:49.532224 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-0ba5fb3a-8071-4a1b-8e9c-583025c08745 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b35218c0034a58bf245444b877ff8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f048337938642b2bf9165db865e8edb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:06:49.540082 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-0ba5fb3a-8071-4a1b-8e9c-583025c08745 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] 10.222.0.59 "GET /compute/v2.1/servers/68102332-bfa3-42b5-b3ef-5840bb67b860" status: 200 len: 1318 microversion: 2.1 time: 0.151456 Aug 26 01:06:49.540689 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 554/1102] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:06:49 2022] GET /compute/v2.1/servers/68102332-bfa3-42b5-b3ef-5840bb67b860 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:06:50.561709 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-0259b539-b55b-432d-8a27-7af10c944d1f tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:06:50.562359 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-0259b539-b55b-432d-8a27-7af10c944d1f tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] [instance: 68102332-bfa3-42b5-b3ef-5840bb67b860] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:06:50.569072 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0259b539-b55b-432d-8a27-7af10c944d1f tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:06:50.569552 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0259b539-b55b-432d-8a27-7af10c944d1f tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:06:50.569985 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0259b539-b55b-432d-8a27-7af10c944d1f tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:06:50.570679 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0259b539-b55b-432d-8a27-7af10c944d1f tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:06:50.571130 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0259b539-b55b-432d-8a27-7af10c944d1f tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:06:50.571553 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0259b539-b55b-432d-8a27-7af10c944d1f tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:06:50.706792 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-0259b539-b55b-432d-8a27-7af10c944d1f tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b35218c0034a58bf245444b877ff8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f048337938642b2bf9165db865e8edb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:06:50.714641 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-0259b539-b55b-432d-8a27-7af10c944d1f tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] 10.222.0.59 "GET /compute/v2.1/servers/68102332-bfa3-42b5-b3ef-5840bb67b860" status: 200 len: 1318 microversion: 2.1 time: 0.157284 Aug 26 01:06:50.715821 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 549/1103] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:06:50 2022] GET /compute/v2.1/servers/68102332-bfa3-42b5-b3ef-5840bb67b860 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:06:51.736800 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-ec786e79-c453-4013-9bce-0c52ad296c40 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:06:51.737337 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-ec786e79-c453-4013-9bce-0c52ad296c40 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] [instance: 68102332-bfa3-42b5-b3ef-5840bb67b860] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:06:51.743244 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ec786e79-c453-4013-9bce-0c52ad296c40 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:06:51.743722 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ec786e79-c453-4013-9bce-0c52ad296c40 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:06:51.744156 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ec786e79-c453-4013-9bce-0c52ad296c40 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:06:51.744864 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ec786e79-c453-4013-9bce-0c52ad296c40 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:06:51.745313 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ec786e79-c453-4013-9bce-0c52ad296c40 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:06:51.745737 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ec786e79-c453-4013-9bce-0c52ad296c40 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:06:52.135082 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-ec786e79-c453-4013-9bce-0c52ad296c40 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b35218c0034a58bf245444b877ff8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f048337938642b2bf9165db865e8edb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:06:52.142875 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-ec786e79-c453-4013-9bce-0c52ad296c40 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] 10.222.0.59 "GET /compute/v2.1/servers/68102332-bfa3-42b5-b3ef-5840bb67b860" status: 200 len: 1318 microversion: 2.1 time: 0.410132 Aug 26 01:06:52.143429 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 555/1104] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:06:51 2022] GET /compute/v2.1/servers/68102332-bfa3-42b5-b3ef-5840bb67b860 => generated 1318 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:06:53.164227 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-5c60eeb5-a4a2-4395-aa4f-356f2ef63313 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:06:53.164893 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-5c60eeb5-a4a2-4395-aa4f-356f2ef63313 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] [instance: 68102332-bfa3-42b5-b3ef-5840bb67b860] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:06:53.172020 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5c60eeb5-a4a2-4395-aa4f-356f2ef63313 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:06:53.172555 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5c60eeb5-a4a2-4395-aa4f-356f2ef63313 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:06:53.172997 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5c60eeb5-a4a2-4395-aa4f-356f2ef63313 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:06:53.173723 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5c60eeb5-a4a2-4395-aa4f-356f2ef63313 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:06:53.174178 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5c60eeb5-a4a2-4395-aa4f-356f2ef63313 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:06:53.174604 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5c60eeb5-a4a2-4395-aa4f-356f2ef63313 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:06:53.308576 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-5c60eeb5-a4a2-4395-aa4f-356f2ef63313 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b35218c0034a58bf245444b877ff8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f048337938642b2bf9165db865e8edb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:06:53.313195 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-5c60eeb5-a4a2-4395-aa4f-356f2ef63313 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] 10.222.0.59 "GET /compute/v2.1/servers/68102332-bfa3-42b5-b3ef-5840bb67b860" status: 200 len: 1318 microversion: 2.1 time: 0.153079 Aug 26 01:06:53.313746 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 550/1105] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:06:53 2022] GET /compute/v2.1/servers/68102332-bfa3-42b5-b3ef-5840bb67b860 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:06:54.334394 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-4f3c89df-8572-47ea-a7ed-4f564258a7d3 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:06:54.335010 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-4f3c89df-8572-47ea-a7ed-4f564258a7d3 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] [instance: 68102332-bfa3-42b5-b3ef-5840bb67b860] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:06:54.337505 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell0:SELECT=2 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:06:54.342292 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-4f3c89df-8572-47ea-a7ed-4f564258a7d3 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:06:54.342778 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-4f3c89df-8572-47ea-a7ed-4f564258a7d3 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:06:54.343222 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-4f3c89df-8572-47ea-a7ed-4f564258a7d3 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:06:54.343922 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-4f3c89df-8572-47ea-a7ed-4f564258a7d3 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:06:54.344380 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-4f3c89df-8572-47ea-a7ed-4f564258a7d3 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:06:54.344831 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-4f3c89df-8572-47ea-a7ed-4f564258a7d3 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:06:54.431068 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [req-fca582f1-582b-40c6-9330-6554ded64e7d req-f7247b25-6874-4100-9924-d15e3bd41af4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68102332-bfa3-42b5-b3ef-5840bb67b860", "name": "network-vif-plugged", "status": "completed", "tag": "17261063-b975-4e59-996d-2843228e8416"}]} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:06:54.436545 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell0:SELECT=2 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:06:54.443328 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-fca582f1-582b-40c6-9330-6554ded64e7d req-f7247b25-6874-4100-9924-d15e3bd41af4 service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:06:54.444070 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-fca582f1-582b-40c6-9330-6554ded64e7d req-f7247b25-6874-4100-9924-d15e3bd41af4 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:06:54.444741 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-fca582f1-582b-40c6-9330-6554ded64e7d req-f7247b25-6874-4100-9924-d15e3bd41af4 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:06:54.459108 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.compute.server_external_events [req-fca582f1-582b-40c6-9330-6554ded64e7d req-f7247b25-6874-4100-9924-d15e3bd41af4 service nova] Creating event network-vif-plugged:17261063-b975-4e59-996d-2843228e8416 for instance 68102332-bfa3-42b5-b3ef-5840bb67b860 on hv-cinder-83538 Aug 26 01:06:54.464391 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [req-fca582f1-582b-40c6-9330-6554ded64e7d req-f7247b25-6874-4100-9924-d15e3bd41af4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036937 Aug 26 01:06:54.465068 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 551/1106] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 01:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 01:06:54.482461 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-4f3c89df-8572-47ea-a7ed-4f564258a7d3 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b35218c0034a58bf245444b877ff8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f048337938642b2bf9165db865e8edb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:06:54.490084 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-4f3c89df-8572-47ea-a7ed-4f564258a7d3 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] 10.222.0.59 "GET /compute/v2.1/servers/68102332-bfa3-42b5-b3ef-5840bb67b860" status: 200 len: 1318 microversion: 2.1 time: 0.159666 Aug 26 01:06:54.490675 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 556/1107] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:06:54 2022] GET /compute/v2.1/servers/68102332-bfa3-42b5-b3ef-5840bb67b860 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:06:55.512320 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-dc1ea571-020c-43db-9997-c73b4d527fb6 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:06:55.513051 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-dc1ea571-020c-43db-9997-c73b4d527fb6 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] [instance: 68102332-bfa3-42b5-b3ef-5840bb67b860] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:06:55.519285 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-dc1ea571-020c-43db-9997-c73b4d527fb6 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:06:55.519764 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-dc1ea571-020c-43db-9997-c73b4d527fb6 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:06:55.520201 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-dc1ea571-020c-43db-9997-c73b4d527fb6 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:06:55.520926 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-dc1ea571-020c-43db-9997-c73b4d527fb6 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:06:55.521382 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-dc1ea571-020c-43db-9997-c73b4d527fb6 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:06:55.521806 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-dc1ea571-020c-43db-9997-c73b4d527fb6 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:06:55.653309 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-dc1ea571-020c-43db-9997-c73b4d527fb6 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b35218c0034a58bf245444b877ff8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f048337938642b2bf9165db865e8edb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:06:55.660788 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-dc1ea571-020c-43db-9997-c73b4d527fb6 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] 10.222.0.59 "GET /compute/v2.1/servers/68102332-bfa3-42b5-b3ef-5840bb67b860" status: 200 len: 1318 microversion: 2.1 time: 0.153521 Aug 26 01:06:55.661345 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 552/1108] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:06:55 2022] GET /compute/v2.1/servers/68102332-bfa3-42b5-b3ef-5840bb67b860 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:06:56.680786 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-43f914dc-ec76-46a6-92b8-61893e839e50 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:06:56.681402 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-43f914dc-ec76-46a6-92b8-61893e839e50 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] [instance: 68102332-bfa3-42b5-b3ef-5840bb67b860] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:06:56.683230 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell0:SELECT=8 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:06:56.689338 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-43f914dc-ec76-46a6-92b8-61893e839e50 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:06:56.689807 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-43f914dc-ec76-46a6-92b8-61893e839e50 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:06:56.690247 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-43f914dc-ec76-46a6-92b8-61893e839e50 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:06:56.691064 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-43f914dc-ec76-46a6-92b8-61893e839e50 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:06:56.691524 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-43f914dc-ec76-46a6-92b8-61893e839e50 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:06:56.691983 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-43f914dc-ec76-46a6-92b8-61893e839e50 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:06:56.819367 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-43f914dc-ec76-46a6-92b8-61893e839e50 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b35218c0034a58bf245444b877ff8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f048337938642b2bf9165db865e8edb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:06:56.826982 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-43f914dc-ec76-46a6-92b8-61893e839e50 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] 10.222.0.59 "GET /compute/v2.1/servers/68102332-bfa3-42b5-b3ef-5840bb67b860" status: 200 len: 1506 microversion: 2.1 time: 0.150088 Aug 26 01:06:56.827534 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 557/1109] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:06:56 2022] GET /compute/v2.1/servers/68102332-bfa3-42b5-b3ef-5840bb67b860 => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:07:12.436589 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-f8c6371d-fbec-4a80-aa47-1e37fe4689c9 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6ae7d09f-c087-4dbd-a2ad-00a0162aad0e", "device": "/dev/sdb"}} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:07:12.439427 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-f8c6371d-fbec-4a80-aa47-1e37fe4689c9 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] [instance: 68102332-bfa3-42b5-b3ef-5840bb67b860] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:07:12.441950 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_api:SELECT=29,nova_api:DELETE=1 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:07:12.442717 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell1:SELECT=50 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:07:12.447572 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f8c6371d-fbec-4a80-aa47-1e37fe4689c9 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:07:12.449817 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f8c6371d-fbec-4a80-aa47-1e37fe4689c9 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:07:12.449817 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f8c6371d-fbec-4a80-aa47-1e37fe4689c9 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:07:12.449817 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f8c6371d-fbec-4a80-aa47-1e37fe4689c9 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:07:12.449817 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f8c6371d-fbec-4a80-aa47-1e37fe4689c9 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:07:12.450761 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f8c6371d-fbec-4a80-aa47-1e37fe4689c9 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:07:13.410883 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-f8c6371d-fbec-4a80-aa47-1e37fe4689c9 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] 10.222.0.59 "POST /compute/v2.1/servers/68102332-bfa3-42b5-b3ef-5840bb67b860/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.978569 Aug 26 01:07:13.411491 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 553/1110] 10.222.0.59 () {60 vars in 1323 bytes} [Fri Aug 26 01:07:12 2022] POST /compute/v2.1/servers/68102332-bfa3-42b5-b3ef-5840bb67b860/os-volume_attachments => generated 194 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:07:39.840649 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-6e99e489-2e69-42d3-b35d-c070c4b5a787 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:07:39.841185 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-6e99e489-2e69-42d3-b35d-c070c4b5a787 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] [instance: 68102332-bfa3-42b5-b3ef-5840bb67b860] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:07:39.843067 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:07:39.844435 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:07:39.845223 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 26 01:07:39.845357 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Fri Aug 26 01:07:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/68102332-bfa3-42b5-b3ef-5840bb67b860/os-volume_attachments/6ae7d09f-c087-4dbd-a2ad-00a0162aad0e (ip 10.222.0.59) !!! Aug 26 01:07:39.851239 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6e99e489-2e69-42d3-b35d-c070c4b5a787 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:07:39.856649 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6e99e489-2e69-42d3-b35d-c070c4b5a787 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:07:39.856649 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6e99e489-2e69-42d3-b35d-c070c4b5a787 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:07:39.856649 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6e99e489-2e69-42d3-b35d-c070c4b5a787 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:07:39.856649 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6e99e489-2e69-42d3-b35d-c070c4b5a787 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:07:39.857050 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-6e99e489-2e69-42d3-b35d-c070c4b5a787 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:07:39.934582 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.objects.instance [None req-6e99e489-2e69-42d3-b35d-c070c4b5a787 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lazy-loading 'services' on Instance uuid 68102332-bfa3-42b5-b3ef-5840bb67b860 {{(pid=127564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 01:07:40.211150 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-6e99e489-2e69-42d3-b35d-c070c4b5a787 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] 10.222.0.59 "DELETE /compute/v2.1/servers/68102332-bfa3-42b5-b3ef-5840bb67b860/os-volume_attachments/6ae7d09f-c087-4dbd-a2ad-00a0162aad0e" status: 202 len: 0 microversion: 2.1 time: 0.374294 Aug 26 01:07:40.211738 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 558/1111] 10.222.0.59 () {58 vars in 1416 bytes} [Fri Aug 26 01:07:39 2022] DELETE /compute/v2.1/servers/68102332-bfa3-42b5-b3ef-5840bb67b860/os-volume_attachments/6ae7d09f-c087-4dbd-a2ad-00a0162aad0e => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 26 01:07:41.327219 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_api:SELECT=2 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:07:41.327980 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:07:41.329138 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 26 01:07:41.329282 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Fri Aug 26 01:07:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/68102332-bfa3-42b5-b3ef-5840bb67b860 (ip 10.222.0.59) !!! Aug 26 01:07:41.334257 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-5eac3f46-0682-45b9-87ee-f4738bfaf517 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:07:41.334869 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-5eac3f46-0682-45b9-87ee-f4738bfaf517 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] [instance: 68102332-bfa3-42b5-b3ef-5840bb67b860] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:07:41.342167 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5eac3f46-0682-45b9-87ee-f4738bfaf517 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:07:41.342645 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5eac3f46-0682-45b9-87ee-f4738bfaf517 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:07:41.343075 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5eac3f46-0682-45b9-87ee-f4738bfaf517 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:07:41.343758 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5eac3f46-0682-45b9-87ee-f4738bfaf517 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:07:41.344216 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5eac3f46-0682-45b9-87ee-f4738bfaf517 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:07:41.344665 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5eac3f46-0682-45b9-87ee-f4738bfaf517 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:07:41.370670 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-5eac3f46-0682-45b9-87ee-f4738bfaf517 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] [instance: 68102332-bfa3-42b5-b3ef-5840bb67b860] Going to try to terminate instance {{(pid=127565) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 01:07:41.809527 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-5eac3f46-0682-45b9-87ee-f4738bfaf517 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] 10.222.0.59 "DELETE /compute/v2.1/servers/68102332-bfa3-42b5-b3ef-5840bb67b860" status: 204 len: 0 microversion: 2.1 time: 0.483463 Aug 26 01:07:41.810153 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 554/1112] 10.222.0.59 () {58 vars in 1239 bytes} [Fri Aug 26 01:07:41 2022] DELETE /compute/v2.1/servers/68102332-bfa3-42b5-b3ef-5840bb67b860 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 01:07:41.819074 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-bbc24d08-2bac-4bab-b7e3-7026aae2eb09 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:07:41.819773 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-bbc24d08-2bac-4bab-b7e3-7026aae2eb09 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] [instance: 68102332-bfa3-42b5-b3ef-5840bb67b860] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:07:41.826569 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bbc24d08-2bac-4bab-b7e3-7026aae2eb09 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:07:41.827078 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bbc24d08-2bac-4bab-b7e3-7026aae2eb09 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:07:41.827513 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bbc24d08-2bac-4bab-b7e3-7026aae2eb09 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:07:41.828200 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bbc24d08-2bac-4bab-b7e3-7026aae2eb09 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:07:41.828683 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bbc24d08-2bac-4bab-b7e3-7026aae2eb09 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:07:41.829114 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bbc24d08-2bac-4bab-b7e3-7026aae2eb09 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:07:41.962672 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-bbc24d08-2bac-4bab-b7e3-7026aae2eb09 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b35218c0034a58bf245444b877ff8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f048337938642b2bf9165db865e8edb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:07:41.971069 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-bbc24d08-2bac-4bab-b7e3-7026aae2eb09 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] 10.222.0.59 "GET /compute/v2.1/servers/68102332-bfa3-42b5-b3ef-5840bb67b860" status: 200 len: 1512 microversion: 2.1 time: 0.156472 Aug 26 01:07:41.971628 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 559/1113] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:07:41 2022] GET /compute/v2.1/servers/68102332-bfa3-42b5-b3ef-5840bb67b860 => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:07:42.993145 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-fefc6a0f-7265-440e-9758-a44c5dce509a tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:07:42.993836 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-fefc6a0f-7265-440e-9758-a44c5dce509a tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] [instance: 68102332-bfa3-42b5-b3ef-5840bb67b860] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:07:43.000171 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-fefc6a0f-7265-440e-9758-a44c5dce509a tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:07:43.000678 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-fefc6a0f-7265-440e-9758-a44c5dce509a tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:07:43.001701 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-fefc6a0f-7265-440e-9758-a44c5dce509a tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:07:43.002383 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-fefc6a0f-7265-440e-9758-a44c5dce509a tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:07:43.002827 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-fefc6a0f-7265-440e-9758-a44c5dce509a tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:07:43.003244 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-fefc6a0f-7265-440e-9758-a44c5dce509a tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:07:43.131893 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-fefc6a0f-7265-440e-9758-a44c5dce509a tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b35218c0034a58bf245444b877ff8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f048337938642b2bf9165db865e8edb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:07:43.139633 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-fefc6a0f-7265-440e-9758-a44c5dce509a tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] 10.222.0.59 "GET /compute/v2.1/servers/68102332-bfa3-42b5-b3ef-5840bb67b860" status: 200 len: 1512 microversion: 2.1 time: 0.150737 Aug 26 01:07:43.140194 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 555/1114] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:07:42 2022] GET /compute/v2.1/servers/68102332-bfa3-42b5-b3ef-5840bb67b860 => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:07:44.090030 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [req-e54f7b42-210b-454e-b83e-bcb41a9d8de6 req-5360f27d-268d-4f48-8245-5d339918625b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68102332-bfa3-42b5-b3ef-5840bb67b860", "name": "network-vif-deleted", "tag": "17261063-b975-4e59-996d-2843228e8416"}]} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:07:44.099860 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-e54f7b42-210b-454e-b83e-bcb41a9d8de6 req-5360f27d-268d-4f48-8245-5d339918625b service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:07:44.100334 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-e54f7b42-210b-454e-b83e-bcb41a9d8de6 req-5360f27d-268d-4f48-8245-5d339918625b service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:07:44.100789 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-e54f7b42-210b-454e-b83e-bcb41a9d8de6 req-5360f27d-268d-4f48-8245-5d339918625b service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:07:44.111409 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.compute.server_external_events [req-e54f7b42-210b-454e-b83e-bcb41a9d8de6 req-5360f27d-268d-4f48-8245-5d339918625b service nova] Creating event network-vif-deleted:17261063-b975-4e59-996d-2843228e8416 for instance 68102332-bfa3-42b5-b3ef-5840bb67b860 on hv-cinder-83538 Aug 26 01:07:44.116728 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [req-e54f7b42-210b-454e-b83e-bcb41a9d8de6 req-5360f27d-268d-4f48-8245-5d339918625b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030323 Aug 26 01:07:44.117312 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 560/1115] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 01:07:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 01:07:44.160149 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-03da7721-ce36-4855-a109-4be813ceebfd tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:07:44.160865 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-03da7721-ce36-4855-a109-4be813ceebfd tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] [instance: 68102332-bfa3-42b5-b3ef-5840bb67b860] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:07:44.167499 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-03da7721-ce36-4855-a109-4be813ceebfd tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:07:44.167978 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-03da7721-ce36-4855-a109-4be813ceebfd tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:07:44.168415 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-03da7721-ce36-4855-a109-4be813ceebfd tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:07:44.169145 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-03da7721-ce36-4855-a109-4be813ceebfd tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:07:44.169592 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-03da7721-ce36-4855-a109-4be813ceebfd tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:07:44.170022 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-03da7721-ce36-4855-a109-4be813ceebfd tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:07:44.233259 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-03da7721-ce36-4855-a109-4be813ceebfd tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b35218c0034a58bf245444b877ff8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f048337938642b2bf9165db865e8edb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:07:44.241592 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-03da7721-ce36-4855-a109-4be813ceebfd tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] 10.222.0.59 "GET /compute/v2.1/servers/68102332-bfa3-42b5-b3ef-5840bb67b860" status: 200 len: 1470 microversion: 2.1 time: 0.085260 Aug 26 01:07:44.242309 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 556/1116] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:07:44 2022] GET /compute/v2.1/servers/68102332-bfa3-42b5-b3ef-5840bb67b860 => generated 1470 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:07:45.263872 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-ade2692b-cadb-4a74-a11c-81956fedaf28 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:07:45.264608 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-ade2692b-cadb-4a74-a11c-81956fedaf28 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] [instance: 68102332-bfa3-42b5-b3ef-5840bb67b860] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:07:45.271804 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ade2692b-cadb-4a74-a11c-81956fedaf28 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:07:45.272288 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ade2692b-cadb-4a74-a11c-81956fedaf28 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:07:45.272762 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ade2692b-cadb-4a74-a11c-81956fedaf28 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:07:45.273556 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ade2692b-cadb-4a74-a11c-81956fedaf28 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:07:45.274015 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ade2692b-cadb-4a74-a11c-81956fedaf28 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:07:45.274445 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ade2692b-cadb-4a74-a11c-81956fedaf28 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:07:45.288168 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.wsgi [None req-ade2692b-cadb-4a74-a11c-81956fedaf28 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] HTTP exception thrown: Instance 68102332-bfa3-42b5-b3ef-5840bb67b860 could not be found. Aug 26 01:07:45.289808 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-ade2692b-cadb-4a74-a11c-81956fedaf28 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Request method failure captured: Aug 26 01:07:45.289808 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: request: GET /compute/v2.1/servers/68102332-bfa3-42b5-b3ef-5840bb67b860 HTTP/1.1 Aug 26 01:07:45.289808 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Accept: application/json Aug 26 01:07:45.289808 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Accept-Encoding: identity Aug 26 01:07:45.289808 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Connection: close Aug 26 01:07:45.289808 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Content-Length: 0 Aug 26 01:07:45.289808 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Content-Type: application/json Aug 26 01:07:45.289808 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Host: 10.222.0.59 Aug 26 01:07:45.289808 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Openstack-System-Scope: None Aug 26 01:07:45.289808 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: User-Agent: python-urllib3/1.26.11 Aug 26 01:07:45.289808 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Auth-Token: gAAAAABjCBygvtk-ugEWKwxmqoOLHZXSrAjFUHNiDX_sSued0PWSAPMpqOBWGTh1JFDeBvp0se4rah24eWsU-F2eeg9yBRZw2WiXYWR3Os6kI0b8TdPK-RBUmAEsqc0VN41QutGQkZt0qjTkQE-JXG8TrI4n2wg55LgAvYSmXJYnPfqaWvRTp7k Aug 26 01:07:45.289808 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Domain-Id: None Aug 26 01:07:45.289808 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Domain-Name: None Aug 26 01:07:45.289808 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Identity-Status: Confirmed Aug 26 01:07:45.289808 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Is-Admin-Project: True Aug 26 01:07:45.289808 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Domain-Id: default Aug 26 01:07:45.289808 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Domain-Name: Default Aug 26 01:07:45.289808 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Id: 0f048337938642b2bf9165db865e8edb Aug 26 01:07:45.289808 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Name: tempest-VolumesSnapshotTestJSON-616714406 Aug 26 01:07:45.289808 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Role: reader,member Aug 26 01:07:45.289808 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Roles: reader,member Aug 26 01:07:45.292105 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0f048337938642b2bf9165db865e8edb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0f048337938642b2bf9165db865e8edb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0f048337938642b2bf9165db865e8edb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0f048337938642b2bf9165db865e8edb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 01:07:45.292105 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant: tempest-VolumesSnapshotTestJSON-616714406 Aug 26 01:07:45.292105 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant-Id: 0f048337938642b2bf9165db865e8edb Aug 26 01:07:45.292105 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-616714406 Aug 26 01:07:45.292105 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User: tempest-VolumesSnapshotTestJSON-616714406-project Aug 26 01:07:45.292105 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Domain-Id: default Aug 26 01:07:45.292105 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Domain-Name: Default Aug 26 01:07:45.292105 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Id: a4b35218c0034a58bf245444b877ff8e Aug 26 01:07:45.292105 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Name: tempest-VolumesSnapshotTestJSON-616714406-project Aug 26 01:07:45.292105 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: method: > Aug 26 01:07:45.292105 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: exception: Instance 68102332-bfa3-42b5-b3ef-5840bb67b860 could not be found. Aug 26 01:07:45.292105 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: action_args: {'id': '68102332-bfa3-42b5-b3ef-5840bb67b860'} Aug 26 01:07:45.293939 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 01:07:45.293939 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:07:45.293939 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 01:07:45.293939 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 01:07:45.293939 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 01:07:45.293939 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 01:07:45.293939 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 01:07:45.293939 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 01:07:45.293939 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 01:07:45.293939 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 01:07:45.293939 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68102332-bfa3-42b5-b3ef-5840bb67b860 could not be found. Aug 26 01:07:45.293939 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:07:45.293939 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:07:45.293939 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:07:45.293939 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:07:45.293939 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:07:45.293939 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:07:45.293939 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 01:07:45.293939 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 01:07:45.293939 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 01:07:45.297027 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 01:07:45.297027 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 01:07:45.297027 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 01:07:45.297027 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 01:07:45.297027 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 01:07:45.297027 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 01:07:45.297027 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 01:07:45.297027 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68102332-bfa3-42b5-b3ef-5840bb67b860 could not be found. Aug 26 01:07:45.297027 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:07:45.297027 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:07:45.297027 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:07:45.297027 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:07:45.297027 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:07:45.297027 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:07:45.297027 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 01:07:45.297027 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 01:07:45.297027 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68102332-bfa3-42b5-b3ef-5840bb67b860 could not be found. Aug 26 01:07:45.297027 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:07:45.299498 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-ade2692b-cadb-4a74-a11c-81956fedaf28 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Returning 404 to user: Instance 68102332-bfa3-42b5-b3ef-5840bb67b860 could not be found. {{(pid=127564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 01:07:45.299498 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-ade2692b-cadb-4a74-a11c-81956fedaf28 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] 10.222.0.59 "GET /compute/v2.1/servers/68102332-bfa3-42b5-b3ef-5840bb67b860" status: 404 len: 111 microversion: 2.1 time: 0.031592 Aug 26 01:07:45.299498 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 561/1117] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:07:45 2022] GET /compute/v2.1/servers/68102332-bfa3-42b5-b3ef-5840bb67b860 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 01:07:53.786897 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-59806211-b74b-4191-9444-3a0a19426c97 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1898377369", "imageRef": "ef60327f-6e0c-4f85-8db9-6f6e8968fe9c", "flavorRef": "452", "networks": [{"uuid": "a8f76b0c-a13d-4adf-aac7-f2a0a3c67769"}]}} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:07:53.841572 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.network.neutron [None req-59806211-b74b-4191-9444-3a0a19426c97 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] validate_networks() for [('a8f76b0c-a13d-4adf-aac7-f2a0a3c67769', None, None, None, None, None)] {{(pid=127565) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 01:07:54.185636 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.virt.hardware [None req-59806211-b74b-4191-9444-3a0a19426c97 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Flavor limits 0:0:0 {{(pid=127565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 01:07:54.186065 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.virt.hardware [None req-59806211-b74b-4191-9444-3a0a19426c97 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Image limits 0:0:0 {{(pid=127565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 01:07:54.186541 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.virt.hardware [None req-59806211-b74b-4191-9444-3a0a19426c97 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Flavor pref 0:0:0 {{(pid=127565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 01:07:54.186951 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.virt.hardware [None req-59806211-b74b-4191-9444-3a0a19426c97 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Image pref 0:0:0 {{(pid=127565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 01:07:54.187371 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.virt.hardware [None req-59806211-b74b-4191-9444-3a0a19426c97 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 01:07:54.196091 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-59806211-b74b-4191-9444-3a0a19426c97 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:07:54.196603 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-59806211-b74b-4191-9444-3a0a19426c97 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:07:54.197040 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-59806211-b74b-4191-9444-3a0a19426c97 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:07:54.197772 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-59806211-b74b-4191-9444-3a0a19426c97 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:07:54.198223 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-59806211-b74b-4191-9444-3a0a19426c97 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:07:54.198650 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-59806211-b74b-4191-9444-3a0a19426c97 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:07:54.220631 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.quota [None req-59806211-b74b-4191-9444-3a0a19426c97 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Getting quotas for project 0f048337938642b2bf9165db865e8edb. Resources: {'instances', 'ram', 'cores'} {{(pid=127565) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 01:07:54.225185 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.quota [None req-59806211-b74b-4191-9444-3a0a19426c97 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Getting quotas for user a4b35218c0034a58bf245444b877ff8e and project 0f048337938642b2bf9165db865e8edb. Resources: {'instances', 'ram', 'cores'} {{(pid=127565) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 01:07:54.236024 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-59806211-b74b-4191-9444-3a0a19426c97 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Going to run 1 instances... {{(pid=127565) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 01:07:54.238324 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-59806211-b74b-4191-9444-3a0a19426c97 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] [instance: a3b5e858-3421-4a85-a153-34b3f124813c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ef60327f-6e0c-4f85-8db9-6f6e8968fe9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127565) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 01:07:54.419606 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-59806211-b74b-4191-9444-3a0a19426c97 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.637781 Aug 26 01:07:54.420501 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 557/1118] 10.222.0.59 () {60 vars in 1147 bytes} [Fri Aug 26 01:07:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 01:07:54.431083 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-b7db1a4d-5cdf-4672-a26a-ce2fa9c53461 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:07:54.431701 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-b7db1a4d-5cdf-4672-a26a-ce2fa9c53461 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] [instance: a3b5e858-3421-4a85-a153-34b3f124813c] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:07:54.489395 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-b7db1a4d-5cdf-4672-a26a-ce2fa9c53461 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b35218c0034a58bf245444b877ff8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f048337938642b2bf9165db865e8edb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:07:54.493393 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-b7db1a4d-5cdf-4672-a26a-ce2fa9c53461 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] 10.222.0.59 "GET /compute/v2.1/servers/a3b5e858-3421-4a85-a153-34b3f124813c" status: 200 len: 1219 microversion: 2.1 time: 0.066343 Aug 26 01:07:54.494175 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 562/1119] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:07:54 2022] GET /compute/v2.1/servers/a3b5e858-3421-4a85-a153-34b3f124813c => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:07:55.514279 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-faf52f83-22b5-448d-bc5b-d34a78ca4dc2 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:07:55.514888 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-faf52f83-22b5-448d-bc5b-d34a78ca4dc2 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] [instance: a3b5e858-3421-4a85-a153-34b3f124813c] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:07:55.522467 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-faf52f83-22b5-448d-bc5b-d34a78ca4dc2 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:07:55.522945 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-faf52f83-22b5-448d-bc5b-d34a78ca4dc2 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:07:55.523379 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-faf52f83-22b5-448d-bc5b-d34a78ca4dc2 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:07:55.524061 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-faf52f83-22b5-448d-bc5b-d34a78ca4dc2 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:07:55.524532 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-faf52f83-22b5-448d-bc5b-d34a78ca4dc2 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:07:55.524956 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-faf52f83-22b5-448d-bc5b-d34a78ca4dc2 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:07:55.591858 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-faf52f83-22b5-448d-bc5b-d34a78ca4dc2 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b35218c0034a58bf245444b877ff8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f048337938642b2bf9165db865e8edb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:07:55.600301 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-faf52f83-22b5-448d-bc5b-d34a78ca4dc2 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] 10.222.0.59 "GET /compute/v2.1/servers/a3b5e858-3421-4a85-a153-34b3f124813c" status: 200 len: 1223 microversion: 2.1 time: 0.090493 Aug 26 01:07:55.600891 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 558/1120] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:07:55 2022] GET /compute/v2.1/servers/a3b5e858-3421-4a85-a153-34b3f124813c => generated 1223 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:07:56.620453 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-108a7bdf-b8c1-40ff-bf14-d636021e7310 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:07:56.621244 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-108a7bdf-b8c1-40ff-bf14-d636021e7310 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] [instance: a3b5e858-3421-4a85-a153-34b3f124813c] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:07:56.623251 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:07:56.630110 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-108a7bdf-b8c1-40ff-bf14-d636021e7310 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:07:56.630622 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-108a7bdf-b8c1-40ff-bf14-d636021e7310 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:07:56.631038 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-108a7bdf-b8c1-40ff-bf14-d636021e7310 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:07:56.631729 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-108a7bdf-b8c1-40ff-bf14-d636021e7310 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:07:56.632268 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-108a7bdf-b8c1-40ff-bf14-d636021e7310 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:07:56.632722 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-108a7bdf-b8c1-40ff-bf14-d636021e7310 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:07:56.709505 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-108a7bdf-b8c1-40ff-bf14-d636021e7310 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b35218c0034a58bf245444b877ff8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f048337938642b2bf9165db865e8edb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:07:56.717076 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-108a7bdf-b8c1-40ff-bf14-d636021e7310 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] 10.222.0.59 "GET /compute/v2.1/servers/a3b5e858-3421-4a85-a153-34b3f124813c" status: 200 len: 1279 microversion: 2.1 time: 0.100438 Aug 26 01:07:56.717652 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 563/1121] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:07:56 2022] GET /compute/v2.1/servers/a3b5e858-3421-4a85-a153-34b3f124813c => generated 1279 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:07:57.738177 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-d39838ff-8f5e-43af-8ebe-60a085ca4a6f tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:07:57.738780 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-d39838ff-8f5e-43af-8ebe-60a085ca4a6f tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] [instance: a3b5e858-3421-4a85-a153-34b3f124813c] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:07:57.745151 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d39838ff-8f5e-43af-8ebe-60a085ca4a6f tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:07:57.745630 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d39838ff-8f5e-43af-8ebe-60a085ca4a6f tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:07:57.746063 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d39838ff-8f5e-43af-8ebe-60a085ca4a6f tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:07:57.746751 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d39838ff-8f5e-43af-8ebe-60a085ca4a6f tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:07:57.747212 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d39838ff-8f5e-43af-8ebe-60a085ca4a6f tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:07:57.747619 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-d39838ff-8f5e-43af-8ebe-60a085ca4a6f tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:07:57.877861 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-d39838ff-8f5e-43af-8ebe-60a085ca4a6f tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b35218c0034a58bf245444b877ff8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f048337938642b2bf9165db865e8edb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:07:57.886004 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-d39838ff-8f5e-43af-8ebe-60a085ca4a6f tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] 10.222.0.59 "GET /compute/v2.1/servers/a3b5e858-3421-4a85-a153-34b3f124813c" status: 200 len: 1319 microversion: 2.1 time: 0.151764 Aug 26 01:07:57.886568 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 559/1122] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:07:57 2022] GET /compute/v2.1/servers/a3b5e858-3421-4a85-a153-34b3f124813c => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:07:58.240798 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [req-3b1a7fce-a2e0-45f9-8f1e-f932bfaa7805 req-efd2c424-8720-4957-aa9b-d37cb7ed7386 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3b5e858-3421-4a85-a153-34b3f124813c", "tag": "f49beef8-eaef-4592-b986-9e8da8e860ca"}]} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:07:58.251126 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-3b1a7fce-a2e0-45f9-8f1e-f932bfaa7805 req-efd2c424-8720-4957-aa9b-d37cb7ed7386 service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:07:58.251609 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-3b1a7fce-a2e0-45f9-8f1e-f932bfaa7805 req-efd2c424-8720-4957-aa9b-d37cb7ed7386 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:07:58.252078 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-3b1a7fce-a2e0-45f9-8f1e-f932bfaa7805 req-efd2c424-8720-4957-aa9b-d37cb7ed7386 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:07:58.263209 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.compute.server_external_events [req-3b1a7fce-a2e0-45f9-8f1e-f932bfaa7805 req-efd2c424-8720-4957-aa9b-d37cb7ed7386 service nova] Creating event network-changed:f49beef8-eaef-4592-b986-9e8da8e860ca for instance a3b5e858-3421-4a85-a153-34b3f124813c on hv-cinder-83538 Aug 26 01:07:58.268126 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [req-3b1a7fce-a2e0-45f9-8f1e-f932bfaa7805 req-efd2c424-8720-4957-aa9b-d37cb7ed7386 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032192 Aug 26 01:07:58.273092 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 564/1123] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 01:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 01:07:58.909003 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-ba929015-ebf6-4388-a3cc-12c049db6c49 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:07:58.909614 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-ba929015-ebf6-4388-a3cc-12c049db6c49 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] [instance: a3b5e858-3421-4a85-a153-34b3f124813c] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:07:58.917118 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ba929015-ebf6-4388-a3cc-12c049db6c49 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:07:58.917599 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ba929015-ebf6-4388-a3cc-12c049db6c49 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:07:58.918054 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ba929015-ebf6-4388-a3cc-12c049db6c49 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:07:58.918740 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ba929015-ebf6-4388-a3cc-12c049db6c49 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:07:58.919188 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ba929015-ebf6-4388-a3cc-12c049db6c49 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:07:58.919608 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ba929015-ebf6-4388-a3cc-12c049db6c49 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:07:59.050092 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-ba929015-ebf6-4388-a3cc-12c049db6c49 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b35218c0034a58bf245444b877ff8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f048337938642b2bf9165db865e8edb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:07:59.058473 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-ba929015-ebf6-4388-a3cc-12c049db6c49 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] 10.222.0.59 "GET /compute/v2.1/servers/a3b5e858-3421-4a85-a153-34b3f124813c" status: 200 len: 1319 microversion: 2.1 time: 0.153420 Aug 26 01:07:59.058955 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 560/1124] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:07:58 2022] GET /compute/v2.1/servers/a3b5e858-3421-4a85-a153-34b3f124813c => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:08:00.079815 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-90b35e25-21e7-4ac8-a96b-500cd0bb60bd tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:08:00.080540 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-90b35e25-21e7-4ac8-a96b-500cd0bb60bd tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] [instance: a3b5e858-3421-4a85-a153-34b3f124813c] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:08:00.087261 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-90b35e25-21e7-4ac8-a96b-500cd0bb60bd tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:08:00.087749 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-90b35e25-21e7-4ac8-a96b-500cd0bb60bd tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:08:00.088189 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-90b35e25-21e7-4ac8-a96b-500cd0bb60bd tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:08:00.088907 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-90b35e25-21e7-4ac8-a96b-500cd0bb60bd tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:08:00.089367 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-90b35e25-21e7-4ac8-a96b-500cd0bb60bd tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:08:00.089795 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-90b35e25-21e7-4ac8-a96b-500cd0bb60bd tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:08:00.224465 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-90b35e25-21e7-4ac8-a96b-500cd0bb60bd tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b35218c0034a58bf245444b877ff8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f048337938642b2bf9165db865e8edb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:08:00.232507 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-90b35e25-21e7-4ac8-a96b-500cd0bb60bd tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] 10.222.0.59 "GET /compute/v2.1/servers/a3b5e858-3421-4a85-a153-34b3f124813c" status: 200 len: 1319 microversion: 2.1 time: 0.157248 Aug 26 01:08:00.233072 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 565/1125] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:08:00 2022] GET /compute/v2.1/servers/a3b5e858-3421-4a85-a153-34b3f124813c => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:08:01.253373 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-398f8620-e866-4007-9690-dcff02b5fc63 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:08:01.254503 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-398f8620-e866-4007-9690-dcff02b5fc63 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] [instance: a3b5e858-3421-4a85-a153-34b3f124813c] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:08:01.260866 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-398f8620-e866-4007-9690-dcff02b5fc63 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:08:01.261339 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-398f8620-e866-4007-9690-dcff02b5fc63 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:08:01.261778 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-398f8620-e866-4007-9690-dcff02b5fc63 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:08:01.262448 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-398f8620-e866-4007-9690-dcff02b5fc63 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:08:01.262887 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-398f8620-e866-4007-9690-dcff02b5fc63 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:08:01.263304 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-398f8620-e866-4007-9690-dcff02b5fc63 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:08:01.396243 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-398f8620-e866-4007-9690-dcff02b5fc63 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b35218c0034a58bf245444b877ff8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f048337938642b2bf9165db865e8edb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:08:01.404227 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-398f8620-e866-4007-9690-dcff02b5fc63 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] 10.222.0.59 "GET /compute/v2.1/servers/a3b5e858-3421-4a85-a153-34b3f124813c" status: 200 len: 1319 microversion: 2.1 time: 0.154641 Aug 26 01:08:01.404861 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 561/1126] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:08:01 2022] GET /compute/v2.1/servers/a3b5e858-3421-4a85-a153-34b3f124813c => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:08:02.424990 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-e554ebc5-4d6a-43f3-b248-c178a6f4eb51 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:08:02.425631 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-e554ebc5-4d6a-43f3-b248-c178a6f4eb51 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] [instance: a3b5e858-3421-4a85-a153-34b3f124813c] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:08:02.432594 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e554ebc5-4d6a-43f3-b248-c178a6f4eb51 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:08:02.433080 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e554ebc5-4d6a-43f3-b248-c178a6f4eb51 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:08:02.433514 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e554ebc5-4d6a-43f3-b248-c178a6f4eb51 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:08:02.434209 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e554ebc5-4d6a-43f3-b248-c178a6f4eb51 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:08:02.434664 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e554ebc5-4d6a-43f3-b248-c178a6f4eb51 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:08:02.435091 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e554ebc5-4d6a-43f3-b248-c178a6f4eb51 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:08:02.568723 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-e554ebc5-4d6a-43f3-b248-c178a6f4eb51 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b35218c0034a58bf245444b877ff8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f048337938642b2bf9165db865e8edb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:08:02.576301 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-e554ebc5-4d6a-43f3-b248-c178a6f4eb51 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] 10.222.0.59 "GET /compute/v2.1/servers/a3b5e858-3421-4a85-a153-34b3f124813c" status: 200 len: 1319 microversion: 2.1 time: 0.155202 Aug 26 01:08:02.576886 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 566/1127] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:08:02 2022] GET /compute/v2.1/servers/a3b5e858-3421-4a85-a153-34b3f124813c => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:08:03.595783 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-efe0124b-fe25-4712-b703-bc284da56ed8 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:08:03.596394 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-efe0124b-fe25-4712-b703-bc284da56ed8 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] [instance: a3b5e858-3421-4a85-a153-34b3f124813c] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:08:03.602801 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-efe0124b-fe25-4712-b703-bc284da56ed8 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:08:03.603284 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-efe0124b-fe25-4712-b703-bc284da56ed8 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:08:03.603740 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-efe0124b-fe25-4712-b703-bc284da56ed8 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:08:03.604426 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-efe0124b-fe25-4712-b703-bc284da56ed8 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:08:03.604906 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-efe0124b-fe25-4712-b703-bc284da56ed8 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:08:03.605352 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-efe0124b-fe25-4712-b703-bc284da56ed8 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:08:03.735789 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-efe0124b-fe25-4712-b703-bc284da56ed8 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b35218c0034a58bf245444b877ff8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f048337938642b2bf9165db865e8edb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:08:03.744224 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-efe0124b-fe25-4712-b703-bc284da56ed8 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] 10.222.0.59 "GET /compute/v2.1/servers/a3b5e858-3421-4a85-a153-34b3f124813c" status: 200 len: 1319 microversion: 2.1 time: 0.152300 Aug 26 01:08:03.744808 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 562/1128] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:08:03 2022] GET /compute/v2.1/servers/a3b5e858-3421-4a85-a153-34b3f124813c => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:08:04.765853 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-9c09f7be-06f4-4f0a-9db2-5a0efdf42f73 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:08:04.766466 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-9c09f7be-06f4-4f0a-9db2-5a0efdf42f73 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] [instance: a3b5e858-3421-4a85-a153-34b3f124813c] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:08:04.769249 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell0:SELECT=2 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:08:04.774591 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9c09f7be-06f4-4f0a-9db2-5a0efdf42f73 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:08:04.777732 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9c09f7be-06f4-4f0a-9db2-5a0efdf42f73 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:08:04.777732 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9c09f7be-06f4-4f0a-9db2-5a0efdf42f73 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:08:04.777732 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9c09f7be-06f4-4f0a-9db2-5a0efdf42f73 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:08:04.777732 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9c09f7be-06f4-4f0a-9db2-5a0efdf42f73 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:08:04.778169 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9c09f7be-06f4-4f0a-9db2-5a0efdf42f73 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:08:04.908297 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-9c09f7be-06f4-4f0a-9db2-5a0efdf42f73 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b35218c0034a58bf245444b877ff8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f048337938642b2bf9165db865e8edb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:08:04.916886 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-9c09f7be-06f4-4f0a-9db2-5a0efdf42f73 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] 10.222.0.59 "GET /compute/v2.1/servers/a3b5e858-3421-4a85-a153-34b3f124813c" status: 200 len: 1319 microversion: 2.1 time: 0.154828 Aug 26 01:08:04.917448 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 567/1129] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:08:04 2022] GET /compute/v2.1/servers/a3b5e858-3421-4a85-a153-34b3f124813c => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:08:04.961605 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [req-876ec59d-ae33-4ae7-90c3-caf25f17e633 req-40232b42-4722-43ad-a2fc-9ed5f1675fa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3b5e858-3421-4a85-a153-34b3f124813c", "name": "network-vif-plugged", "status": "completed", "tag": "f49beef8-eaef-4592-b986-9e8da8e860ca"}]} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:08:04.966597 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell0:SELECT=2 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:08:04.967263 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell0:SELECT=6 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:08:04.973040 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-876ec59d-ae33-4ae7-90c3-caf25f17e633 req-40232b42-4722-43ad-a2fc-9ed5f1675fa5 service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:08:04.973570 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-876ec59d-ae33-4ae7-90c3-caf25f17e633 req-40232b42-4722-43ad-a2fc-9ed5f1675fa5 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:08:04.974005 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-876ec59d-ae33-4ae7-90c3-caf25f17e633 req-40232b42-4722-43ad-a2fc-9ed5f1675fa5 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:08:04.984833 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.compute.server_external_events [req-876ec59d-ae33-4ae7-90c3-caf25f17e633 req-40232b42-4722-43ad-a2fc-9ed5f1675fa5 service nova] Creating event network-vif-plugged:f49beef8-eaef-4592-b986-9e8da8e860ca for instance a3b5e858-3421-4a85-a153-34b3f124813c on hv-cinder-83538 Aug 26 01:08:04.989876 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [req-876ec59d-ae33-4ae7-90c3-caf25f17e633 req-40232b42-4722-43ad-a2fc-9ed5f1675fa5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032576 Aug 26 01:08:04.992543 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 563/1130] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 01:08:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:08:05.945101 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-14d3d554-ab6e-48f0-bbdc-598dfb741813 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:08:05.945810 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-14d3d554-ab6e-48f0-bbdc-598dfb741813 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] [instance: a3b5e858-3421-4a85-a153-34b3f124813c] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:08:05.952151 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-14d3d554-ab6e-48f0-bbdc-598dfb741813 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:08:05.952677 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-14d3d554-ab6e-48f0-bbdc-598dfb741813 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:08:05.953121 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-14d3d554-ab6e-48f0-bbdc-598dfb741813 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:08:05.953821 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-14d3d554-ab6e-48f0-bbdc-598dfb741813 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:08:05.954279 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-14d3d554-ab6e-48f0-bbdc-598dfb741813 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:08:05.954703 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-14d3d554-ab6e-48f0-bbdc-598dfb741813 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:08:06.085351 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-14d3d554-ab6e-48f0-bbdc-598dfb741813 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b35218c0034a58bf245444b877ff8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f048337938642b2bf9165db865e8edb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:08:06.092935 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-14d3d554-ab6e-48f0-bbdc-598dfb741813 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] 10.222.0.59 "GET /compute/v2.1/servers/a3b5e858-3421-4a85-a153-34b3f124813c" status: 200 len: 1319 microversion: 2.1 time: 0.151926 Aug 26 01:08:06.093493 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 568/1131] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:08:05 2022] GET /compute/v2.1/servers/a3b5e858-3421-4a85-a153-34b3f124813c => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:08:07.115528 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-7fdf0247-4b1e-4f9a-8666-60dfd4b2bcca tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:08:07.116222 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-7fdf0247-4b1e-4f9a-8666-60dfd4b2bcca tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] [instance: a3b5e858-3421-4a85-a153-34b3f124813c] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:08:07.123003 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7fdf0247-4b1e-4f9a-8666-60dfd4b2bcca tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:08:07.123482 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7fdf0247-4b1e-4f9a-8666-60dfd4b2bcca tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:08:07.123940 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7fdf0247-4b1e-4f9a-8666-60dfd4b2bcca tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:08:07.124647 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7fdf0247-4b1e-4f9a-8666-60dfd4b2bcca tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:08:07.125093 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7fdf0247-4b1e-4f9a-8666-60dfd4b2bcca tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:08:07.125511 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-7fdf0247-4b1e-4f9a-8666-60dfd4b2bcca tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:08:07.261302 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-7fdf0247-4b1e-4f9a-8666-60dfd4b2bcca tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b35218c0034a58bf245444b877ff8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f048337938642b2bf9165db865e8edb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:08:07.269066 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-7fdf0247-4b1e-4f9a-8666-60dfd4b2bcca tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] 10.222.0.59 "GET /compute/v2.1/servers/a3b5e858-3421-4a85-a153-34b3f124813c" status: 200 len: 1507 microversion: 2.1 time: 0.159261 Aug 26 01:08:07.269622 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 564/1132] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:08:07 2022] GET /compute/v2.1/servers/a3b5e858-3421-4a85-a153-34b3f124813c => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:08:07.290533 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-cc4b4ab7-36fd-41d9-8b18-27f4be6360d7 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6e8571a4-28fe-41f9-836f-643012d90eb7", "device": "/dev/sdb"}} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:08:07.293445 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-cc4b4ab7-36fd-41d9-8b18-27f4be6360d7 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] [instance: a3b5e858-3421-4a85-a153-34b3f124813c] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:08:07.300079 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-cc4b4ab7-36fd-41d9-8b18-27f4be6360d7 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:08:07.300609 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-cc4b4ab7-36fd-41d9-8b18-27f4be6360d7 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:08:07.301056 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-cc4b4ab7-36fd-41d9-8b18-27f4be6360d7 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:08:07.302344 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-cc4b4ab7-36fd-41d9-8b18-27f4be6360d7 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:08:07.302806 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-cc4b4ab7-36fd-41d9-8b18-27f4be6360d7 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:08:07.303238 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-cc4b4ab7-36fd-41d9-8b18-27f4be6360d7 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:08:08.242255 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-cc4b4ab7-36fd-41d9-8b18-27f4be6360d7 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] 10.222.0.59 "POST /compute/v2.1/servers/a3b5e858-3421-4a85-a153-34b3f124813c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.956308 Aug 26 01:08:08.242856 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 569/1133] 10.222.0.59 () {60 vars in 1323 bytes} [Fri Aug 26 01:08:07 2022] POST /compute/v2.1/servers/a3b5e858-3421-4a85-a153-34b3f124813c/os-volume_attachments => generated 194 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:08:28.527659 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-4763bf9f-bee3-4acd-b09a-d45e0a97cb8f tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:08:28.528189 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-4763bf9f-bee3-4acd-b09a-d45e0a97cb8f tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] [instance: a3b5e858-3421-4a85-a153-34b3f124813c] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:08:28.530561 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:08:28.531330 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:08:28.536592 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4763bf9f-bee3-4acd-b09a-d45e0a97cb8f tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:08:28.537079 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4763bf9f-bee3-4acd-b09a-d45e0a97cb8f tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:08:28.537764 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4763bf9f-bee3-4acd-b09a-d45e0a97cb8f tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:08:28.538454 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4763bf9f-bee3-4acd-b09a-d45e0a97cb8f tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:08:28.538905 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4763bf9f-bee3-4acd-b09a-d45e0a97cb8f tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:08:28.539327 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4763bf9f-bee3-4acd-b09a-d45e0a97cb8f tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:08:28.619928 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.objects.instance [None req-4763bf9f-bee3-4acd-b09a-d45e0a97cb8f tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lazy-loading 'services' on Instance uuid a3b5e858-3421-4a85-a153-34b3f124813c {{(pid=127565) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 01:08:28.912902 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-4763bf9f-bee3-4acd-b09a-d45e0a97cb8f tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] 10.222.0.59 "DELETE /compute/v2.1/servers/a3b5e858-3421-4a85-a153-34b3f124813c/os-volume_attachments/6e8571a4-28fe-41f9-836f-643012d90eb7" status: 202 len: 0 microversion: 2.1 time: 0.388406 Aug 26 01:08:28.913534 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 565/1134] 10.222.0.59 () {58 vars in 1416 bytes} [Fri Aug 26 01:08:28 2022] DELETE /compute/v2.1/servers/a3b5e858-3421-4a85-a153-34b3f124813c/os-volume_attachments/6e8571a4-28fe-41f9-836f-643012d90eb7 => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 01:08:30.029059 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_api:SELECT=26 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:08:30.034369 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:08:30.034369 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-eef70cc4-33c0-4339-b050-102375b17b94 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:08:30.034586 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-eef70cc4-33c0-4339-b050-102375b17b94 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] [instance: a3b5e858-3421-4a85-a153-34b3f124813c] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:08:30.041043 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-eef70cc4-33c0-4339-b050-102375b17b94 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:08:30.041524 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-eef70cc4-33c0-4339-b050-102375b17b94 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:08:30.041962 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-eef70cc4-33c0-4339-b050-102375b17b94 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:08:30.042653 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-eef70cc4-33c0-4339-b050-102375b17b94 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:08:30.043109 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-eef70cc4-33c0-4339-b050-102375b17b94 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:08:30.043536 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-eef70cc4-33c0-4339-b050-102375b17b94 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:08:30.069076 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-eef70cc4-33c0-4339-b050-102375b17b94 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] [instance: a3b5e858-3421-4a85-a153-34b3f124813c] Going to try to terminate instance {{(pid=127564) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 01:08:30.451123 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-eef70cc4-33c0-4339-b050-102375b17b94 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] 10.222.0.59 "DELETE /compute/v2.1/servers/a3b5e858-3421-4a85-a153-34b3f124813c" status: 204 len: 0 microversion: 2.1 time: 0.423538 Aug 26 01:08:30.451703 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 570/1135] 10.222.0.59 () {58 vars in 1239 bytes} [Fri Aug 26 01:08:30 2022] DELETE /compute/v2.1/servers/a3b5e858-3421-4a85-a153-34b3f124813c => generated 0 bytes in 425 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 01:08:30.460423 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-0230aa51-c935-4d89-9557-9fc63fac22e4 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:08:30.463124 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-0230aa51-c935-4d89-9557-9fc63fac22e4 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] [instance: a3b5e858-3421-4a85-a153-34b3f124813c] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:08:30.468813 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0230aa51-c935-4d89-9557-9fc63fac22e4 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:08:30.469298 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0230aa51-c935-4d89-9557-9fc63fac22e4 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:08:30.469731 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0230aa51-c935-4d89-9557-9fc63fac22e4 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:08:30.470421 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0230aa51-c935-4d89-9557-9fc63fac22e4 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:08:30.470876 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0230aa51-c935-4d89-9557-9fc63fac22e4 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:08:30.471300 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-0230aa51-c935-4d89-9557-9fc63fac22e4 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:08:30.603086 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-0230aa51-c935-4d89-9557-9fc63fac22e4 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b35218c0034a58bf245444b877ff8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f048337938642b2bf9165db865e8edb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:08:30.610805 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-0230aa51-c935-4d89-9557-9fc63fac22e4 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] 10.222.0.59 "GET /compute/v2.1/servers/a3b5e858-3421-4a85-a153-34b3f124813c" status: 200 len: 1513 microversion: 2.1 time: 0.154655 Aug 26 01:08:30.611368 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 566/1136] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:08:30 2022] GET /compute/v2.1/servers/a3b5e858-3421-4a85-a153-34b3f124813c => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:08:31.632770 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-5c943234-52e2-4722-a573-ddb625f97437 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:08:31.633469 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-5c943234-52e2-4722-a573-ddb625f97437 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] [instance: a3b5e858-3421-4a85-a153-34b3f124813c] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:08:31.640057 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5c943234-52e2-4722-a573-ddb625f97437 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:08:31.640641 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5c943234-52e2-4722-a573-ddb625f97437 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:08:31.641083 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5c943234-52e2-4722-a573-ddb625f97437 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:08:31.641782 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5c943234-52e2-4722-a573-ddb625f97437 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:08:31.642237 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5c943234-52e2-4722-a573-ddb625f97437 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:08:31.642664 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-5c943234-52e2-4722-a573-ddb625f97437 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:08:31.781000 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-5c943234-52e2-4722-a573-ddb625f97437 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b35218c0034a58bf245444b877ff8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f048337938642b2bf9165db865e8edb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:08:31.788800 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-5c943234-52e2-4722-a573-ddb625f97437 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] 10.222.0.59 "GET /compute/v2.1/servers/a3b5e858-3421-4a85-a153-34b3f124813c" status: 200 len: 1513 microversion: 2.1 time: 0.160658 Aug 26 01:08:31.789354 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 571/1137] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:08:31 2022] GET /compute/v2.1/servers/a3b5e858-3421-4a85-a153-34b3f124813c => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:08:32.809514 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-18228f0e-df4b-4812-9160-fc832363b7d6 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:08:32.810124 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-18228f0e-df4b-4812-9160-fc832363b7d6 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] [instance: a3b5e858-3421-4a85-a153-34b3f124813c] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:08:32.816612 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-18228f0e-df4b-4812-9160-fc832363b7d6 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:08:32.817140 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-18228f0e-df4b-4812-9160-fc832363b7d6 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:08:32.818071 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-18228f0e-df4b-4812-9160-fc832363b7d6 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:08:32.818757 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-18228f0e-df4b-4812-9160-fc832363b7d6 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:08:32.819207 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-18228f0e-df4b-4812-9160-fc832363b7d6 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:08:32.819625 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-18228f0e-df4b-4812-9160-fc832363b7d6 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:08:32.971456 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-18228f0e-df4b-4812-9160-fc832363b7d6 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b35218c0034a58bf245444b877ff8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f048337938642b2bf9165db865e8edb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:08:32.979294 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-18228f0e-df4b-4812-9160-fc832363b7d6 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] 10.222.0.59 "GET /compute/v2.1/servers/a3b5e858-3421-4a85-a153-34b3f124813c" status: 200 len: 1513 microversion: 2.1 time: 0.173642 Aug 26 01:08:32.984507 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 567/1138] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:08:32 2022] GET /compute/v2.1/servers/a3b5e858-3421-4a85-a153-34b3f124813c => generated 1513 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:08:33.007313 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [req-6398597c-97f1-4122-b02d-ba4f3a432388 req-a2a85a38-db7d-4b5a-8d46-2458eb2e8f73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3b5e858-3421-4a85-a153-34b3f124813c", "name": "network-vif-deleted", "tag": "f49beef8-eaef-4592-b986-9e8da8e860ca"}]} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:08:33.017320 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-6398597c-97f1-4122-b02d-ba4f3a432388 req-a2a85a38-db7d-4b5a-8d46-2458eb2e8f73 service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:08:33.025179 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-6398597c-97f1-4122-b02d-ba4f3a432388 req-a2a85a38-db7d-4b5a-8d46-2458eb2e8f73 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:08:33.025179 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-6398597c-97f1-4122-b02d-ba4f3a432388 req-a2a85a38-db7d-4b5a-8d46-2458eb2e8f73 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:08:33.029655 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.compute.server_external_events [req-6398597c-97f1-4122-b02d-ba4f3a432388 req-a2a85a38-db7d-4b5a-8d46-2458eb2e8f73 service nova] Creating event network-vif-deleted:f49beef8-eaef-4592-b986-9e8da8e860ca for instance a3b5e858-3421-4a85-a153-34b3f124813c on hv-cinder-83538 Aug 26 01:08:33.034437 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [req-6398597c-97f1-4122-b02d-ba4f3a432388 req-a2a85a38-db7d-4b5a-8d46-2458eb2e8f73 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031383 Aug 26 01:08:33.035027 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 572/1139] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 01:08:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:08:34.002453 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-f877fc32-cd06-4cd4-b9c6-8a2162fa0aa8 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:08:34.003070 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-f877fc32-cd06-4cd4-b9c6-8a2162fa0aa8 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] [instance: a3b5e858-3421-4a85-a153-34b3f124813c] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:08:34.010018 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f877fc32-cd06-4cd4-b9c6-8a2162fa0aa8 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:08:34.010500 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f877fc32-cd06-4cd4-b9c6-8a2162fa0aa8 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:08:34.010941 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f877fc32-cd06-4cd4-b9c6-8a2162fa0aa8 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:08:34.011630 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f877fc32-cd06-4cd4-b9c6-8a2162fa0aa8 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:08:34.012080 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f877fc32-cd06-4cd4-b9c6-8a2162fa0aa8 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:08:34.012529 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f877fc32-cd06-4cd4-b9c6-8a2162fa0aa8 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:08:34.044247 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f877fc32-cd06-4cd4-b9c6-8a2162fa0aa8 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:08:34.044766 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f877fc32-cd06-4cd4-b9c6-8a2162fa0aa8 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:08:34.045205 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f877fc32-cd06-4cd4-b9c6-8a2162fa0aa8 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:08:34.047716 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.objects.instance [None req-f877fc32-cd06-4cd4-b9c6-8a2162fa0aa8 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lazy-loading 'fault' on Instance uuid a3b5e858-3421-4a85-a153-34b3f124813c {{(pid=127565) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 01:08:34.091444 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-f877fc32-cd06-4cd4-b9c6-8a2162fa0aa8 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b35218c0034a58bf245444b877ff8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f048337938642b2bf9165db865e8edb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:08:34.099820 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-f877fc32-cd06-4cd4-b9c6-8a2162fa0aa8 tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] 10.222.0.59 "GET /compute/v2.1/servers/a3b5e858-3421-4a85-a153-34b3f124813c" status: 200 len: 1309 microversion: 2.1 time: 0.101138 Aug 26 01:08:34.100403 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 568/1140] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:08:33 2022] GET /compute/v2.1/servers/a3b5e858-3421-4a85-a153-34b3f124813c => generated 1309 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:08:35.122281 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-49df0728-2abf-44ff-af93-7e2d7951e6dd tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:08:35.123003 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-49df0728-2abf-44ff-af93-7e2d7951e6dd tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] [instance: a3b5e858-3421-4a85-a153-34b3f124813c] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:08:35.129285 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-49df0728-2abf-44ff-af93-7e2d7951e6dd tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:08:35.129766 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-49df0728-2abf-44ff-af93-7e2d7951e6dd tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:08:35.130269 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-49df0728-2abf-44ff-af93-7e2d7951e6dd tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:08:35.130934 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-49df0728-2abf-44ff-af93-7e2d7951e6dd tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:08:35.131387 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-49df0728-2abf-44ff-af93-7e2d7951e6dd tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:08:35.131812 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-49df0728-2abf-44ff-af93-7e2d7951e6dd tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:08:35.144936 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.wsgi [None req-49df0728-2abf-44ff-af93-7e2d7951e6dd tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] HTTP exception thrown: Instance a3b5e858-3421-4a85-a153-34b3f124813c could not be found. Aug 26 01:08:35.147063 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-49df0728-2abf-44ff-af93-7e2d7951e6dd tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Request method failure captured: Aug 26 01:08:35.147063 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: request: GET /compute/v2.1/servers/a3b5e858-3421-4a85-a153-34b3f124813c HTTP/1.1 Aug 26 01:08:35.147063 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Accept: application/json Aug 26 01:08:35.147063 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Accept-Encoding: identity Aug 26 01:08:35.147063 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Connection: close Aug 26 01:08:35.147063 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Content-Length: 0 Aug 26 01:08:35.147063 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Content-Type: application/json Aug 26 01:08:35.147063 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Host: 10.222.0.59 Aug 26 01:08:35.147063 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Openstack-System-Scope: None Aug 26 01:08:35.147063 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: User-Agent: python-urllib3/1.26.11 Aug 26 01:08:35.147063 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Auth-Token: gAAAAABjCBygvtk-ugEWKwxmqoOLHZXSrAjFUHNiDX_sSued0PWSAPMpqOBWGTh1JFDeBvp0se4rah24eWsU-F2eeg9yBRZw2WiXYWR3Os6kI0b8TdPK-RBUmAEsqc0VN41QutGQkZt0qjTkQE-JXG8TrI4n2wg55LgAvYSmXJYnPfqaWvRTp7k Aug 26 01:08:35.147063 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Domain-Id: None Aug 26 01:08:35.147063 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Domain-Name: None Aug 26 01:08:35.147063 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Identity-Status: Confirmed Aug 26 01:08:35.147063 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Is-Admin-Project: True Aug 26 01:08:35.147063 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Domain-Id: default Aug 26 01:08:35.147063 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Domain-Name: Default Aug 26 01:08:35.147063 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Id: 0f048337938642b2bf9165db865e8edb Aug 26 01:08:35.147063 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Name: tempest-VolumesSnapshotTestJSON-616714406 Aug 26 01:08:35.147063 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Role: reader,member Aug 26 01:08:35.147063 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Roles: reader,member Aug 26 01:08:35.148880 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0f048337938642b2bf9165db865e8edb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0f048337938642b2bf9165db865e8edb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0f048337938642b2bf9165db865e8edb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0f048337938642b2bf9165db865e8edb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 01:08:35.148880 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant: tempest-VolumesSnapshotTestJSON-616714406 Aug 26 01:08:35.148880 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant-Id: 0f048337938642b2bf9165db865e8edb Aug 26 01:08:35.148880 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-616714406 Aug 26 01:08:35.148880 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User: tempest-VolumesSnapshotTestJSON-616714406-project Aug 26 01:08:35.148880 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Domain-Id: default Aug 26 01:08:35.148880 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Domain-Name: Default Aug 26 01:08:35.148880 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Id: a4b35218c0034a58bf245444b877ff8e Aug 26 01:08:35.148880 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Name: tempest-VolumesSnapshotTestJSON-616714406-project Aug 26 01:08:35.148880 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: method: > Aug 26 01:08:35.148880 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: exception: Instance a3b5e858-3421-4a85-a153-34b3f124813c could not be found. Aug 26 01:08:35.148880 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: action_args: {'id': 'a3b5e858-3421-4a85-a153-34b3f124813c'} Aug 26 01:08:35.149877 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 01:08:35.149877 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:08:35.149877 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 01:08:35.149877 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 01:08:35.149877 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 01:08:35.149877 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 01:08:35.149877 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 01:08:35.149877 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 01:08:35.149877 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 01:08:35.149877 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 01:08:35.149877 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3b5e858-3421-4a85-a153-34b3f124813c could not be found. Aug 26 01:08:35.149877 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:08:35.149877 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:08:35.149877 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:08:35.149877 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:08:35.149877 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:08:35.149877 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:08:35.149877 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 01:08:35.149877 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 01:08:35.149877 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 01:08:35.151655 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 01:08:35.151655 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 01:08:35.151655 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 01:08:35.151655 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 01:08:35.151655 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 01:08:35.151655 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 01:08:35.151655 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 01:08:35.151655 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3b5e858-3421-4a85-a153-34b3f124813c could not be found. Aug 26 01:08:35.151655 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:08:35.151655 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:08:35.151655 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:08:35.151655 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:08:35.151655 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:08:35.151655 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:08:35.151655 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 01:08:35.151655 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 01:08:35.151655 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3b5e858-3421-4a85-a153-34b3f124813c could not be found. Aug 26 01:08:35.151655 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:08:35.153409 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-49df0728-2abf-44ff-af93-7e2d7951e6dd tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] Returning 404 to user: Instance a3b5e858-3421-4a85-a153-34b3f124813c could not be found. {{(pid=127564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 01:08:35.153409 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-49df0728-2abf-44ff-af93-7e2d7951e6dd tempest-VolumesSnapshotTestJSON-616714406 tempest-VolumesSnapshotTestJSON-616714406-project] 10.222.0.59 "GET /compute/v2.1/servers/a3b5e858-3421-4a85-a153-34b3f124813c" status: 404 len: 111 microversion: 2.1 time: 0.030890 Aug 26 01:08:35.153409 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 573/1141] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:08:35 2022] GET /compute/v2.1/servers/a3b5e858-3421-4a85-a153-34b3f124813c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 01:09:29.311016 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-b105ef3d-1538-4f06-ba46-c38fbed29fe6 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Action: 'create', calling method: .version_select at 0x7f8a92ec1f70>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-150683346", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfF3ljPQpMC8QxaPIkeHcrgmJ0E0iyZVo4vOMSz5j7TyvkzotfCW5rySX3SltgnO/Z4SJahRGGKkwF3xmEOAK4diam7/W/9899qtL4OrpcORQ2M6AA6otnBQM67x1dvqQ=="}} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:09:29.316842 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_api:SELECT=10 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:09:29.319829 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:09:29.319829 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 26 01:09:29.319829 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Fri Aug 26 01:09:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.59) !!! Aug 26 01:09:29.337277 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.quota [None req-b105ef3d-1538-4f06-ba46-c38fbed29fe6 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Getting quotas for project 192b8e73733046a188480d27a9092022. Resources: {'key_pairs'} {{(pid=127565) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 01:09:29.341184 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.quota [None req-b105ef3d-1538-4f06-ba46-c38fbed29fe6 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Getting quotas for user e811744d2a884e119076cde1b96f4846 and project 192b8e73733046a188480d27a9092022. Resources: {'key_pairs'} {{(pid=127565) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 01:09:29.443740 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-b105ef3d-1538-4f06-ba46-c38fbed29fe6 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.136770 Aug 26 01:09:29.446143 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 569/1142] 10.222.0.59 () {60 vars in 1159 bytes} [Fri Aug 26 01:09:29 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:09:29.494426 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-ba859135-b5d1-462f-a702-2c7e2c28d1f4 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1252127932", "imageRef": "ee452577-4402-4c4c-b0d5-f604fdbb96c4", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-150683346", "networks": [{"uuid": "f0f83622-0710-4ed4-a21e-88445332d373"}]}} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:09:29.503191 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:09:29.507996 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:09:29.507996 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 26 01:09:29.507996 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Fri Aug 26 01:09:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.59) !!! Aug 26 01:09:29.661752 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.network.neutron [None req-ba859135-b5d1-462f-a702-2c7e2c28d1f4 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] validate_networks() for [('f0f83622-0710-4ed4-a21e-88445332d373', None, None, None, None, None)] {{(pid=127564) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 01:09:30.025583 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.virt.hardware [None req-ba859135-b5d1-462f-a702-2c7e2c28d1f4 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Flavor limits 0:0:0 {{(pid=127564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 01:09:30.026010 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.virt.hardware [None req-ba859135-b5d1-462f-a702-2c7e2c28d1f4 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Image limits 0:0:0 {{(pid=127564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 01:09:30.026485 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.virt.hardware [None req-ba859135-b5d1-462f-a702-2c7e2c28d1f4 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Flavor pref 0:0:0 {{(pid=127564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 01:09:30.026896 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.virt.hardware [None req-ba859135-b5d1-462f-a702-2c7e2c28d1f4 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Image pref 0:0:0 {{(pid=127564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 01:09:30.027311 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.virt.hardware [None req-ba859135-b5d1-462f-a702-2c7e2c28d1f4 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 01:09:30.036293 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ba859135-b5d1-462f-a702-2c7e2c28d1f4 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:09:30.036807 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ba859135-b5d1-462f-a702-2c7e2c28d1f4 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:09:30.037246 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ba859135-b5d1-462f-a702-2c7e2c28d1f4 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:09:30.038234 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ba859135-b5d1-462f-a702-2c7e2c28d1f4 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:09:30.039451 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ba859135-b5d1-462f-a702-2c7e2c28d1f4 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:09:30.039882 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-ba859135-b5d1-462f-a702-2c7e2c28d1f4 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:09:30.056644 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.quota [None req-ba859135-b5d1-462f-a702-2c7e2c28d1f4 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Getting quotas for project 192b8e73733046a188480d27a9092022. Resources: {'instances', 'ram', 'cores'} {{(pid=127564) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 01:09:30.060787 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.quota [None req-ba859135-b5d1-462f-a702-2c7e2c28d1f4 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Getting quotas for user e811744d2a884e119076cde1b96f4846 and project 192b8e73733046a188480d27a9092022. Resources: {'instances', 'ram', 'cores'} {{(pid=127564) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 01:09:30.072040 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-ba859135-b5d1-462f-a702-2c7e2c28d1f4 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Going to run 1 instances... {{(pid=127564) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 01:09:30.074298 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-ba859135-b5d1-462f-a702-2c7e2c28d1f4 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] [instance: f7970ad9-31b5-4946-b689-d7865b3b6462] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ee452577-4402-4c4c-b0d5-f604fdbb96c4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 01:09:30.228573 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-ba859135-b5d1-462f-a702-2c7e2c28d1f4 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.737955 Aug 26 01:09:30.229212 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 574/1143] 10.222.0.59 () {60 vars in 1147 bytes} [Fri Aug 26 01:09:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 01:09:30.239909 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-2e7bb83b-3dd3-4d1f-a6db-1b77e08b35fa tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:09:30.240576 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-2e7bb83b-3dd3-4d1f-a6db-1b77e08b35fa tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] [instance: f7970ad9-31b5-4946-b689-d7865b3b6462] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:09:30.403902 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-2e7bb83b-3dd3-4d1f-a6db-1b77e08b35fa tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811744d2a884e119076cde1b96f4846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192b8e73733046a188480d27a9092022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:09:30.411902 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-2e7bb83b-3dd3-4d1f-a6db-1b77e08b35fa tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] 10.222.0.59 "GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462" status: 200 len: 1258 microversion: 2.1 time: 0.175952 Aug 26 01:09:30.413103 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 570/1144] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:09:30 2022] GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462 => generated 1258 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:09:31.432797 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-5d0307be-ea74-458d-8e06-6c1f6134a37c tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:09:31.433630 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-5d0307be-ea74-458d-8e06-6c1f6134a37c tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] [instance: f7970ad9-31b5-4946-b689-d7865b3b6462] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:09:31.487681 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-5d0307be-ea74-458d-8e06-6c1f6134a37c tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811744d2a884e119076cde1b96f4846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192b8e73733046a188480d27a9092022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:09:31.494655 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-5d0307be-ea74-458d-8e06-6c1f6134a37c tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] 10.222.0.59 "GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462" status: 200 len: 1258 microversion: 2.1 time: 0.065799 Aug 26 01:09:31.495205 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 575/1145] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:09:31 2022] GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462 => generated 1258 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:09:32.514843 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-8c9df0e0-8706-44e6-9425-9935945fc940 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:09:32.515384 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-8c9df0e0-8706-44e6-9425-9935945fc940 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] [instance: f7970ad9-31b5-4946-b689-d7865b3b6462] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:09:32.521855 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8c9df0e0-8706-44e6-9425-9935945fc940 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:09:32.522339 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8c9df0e0-8706-44e6-9425-9935945fc940 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:09:32.522777 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8c9df0e0-8706-44e6-9425-9935945fc940 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:09:32.523462 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8c9df0e0-8706-44e6-9425-9935945fc940 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:09:32.523915 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8c9df0e0-8706-44e6-9425-9935945fc940 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:09:32.524341 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-8c9df0e0-8706-44e6-9425-9935945fc940 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:09:32.588231 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-8c9df0e0-8706-44e6-9425-9935945fc940 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811744d2a884e119076cde1b96f4846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192b8e73733046a188480d27a9092022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:09:32.595977 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-8c9df0e0-8706-44e6-9425-9935945fc940 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] 10.222.0.59 "GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462" status: 200 len: 1310 microversion: 2.1 time: 0.085149 Aug 26 01:09:32.596560 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 571/1146] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:09:32 2022] GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462 => generated 1310 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:09:33.617634 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-b8404c4a-1b9f-4759-90e2-593acc450118 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:09:33.618206 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-b8404c4a-1b9f-4759-90e2-593acc450118 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] [instance: f7970ad9-31b5-4946-b689-d7865b3b6462] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:09:33.635110 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b8404c4a-1b9f-4759-90e2-593acc450118 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:09:33.635110 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b8404c4a-1b9f-4759-90e2-593acc450118 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:09:33.635321 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b8404c4a-1b9f-4759-90e2-593acc450118 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:09:33.635975 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b8404c4a-1b9f-4759-90e2-593acc450118 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:09:33.636669 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b8404c4a-1b9f-4759-90e2-593acc450118 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:09:33.637322 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b8404c4a-1b9f-4759-90e2-593acc450118 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:09:33.834136 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-b8404c4a-1b9f-4759-90e2-593acc450118 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811744d2a884e119076cde1b96f4846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192b8e73733046a188480d27a9092022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:09:33.851574 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-b8404c4a-1b9f-4759-90e2-593acc450118 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] 10.222.0.59 "GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462" status: 200 len: 1358 microversion: 2.1 time: 0.238209 Aug 26 01:09:33.852908 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 576/1147] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:09:33 2022] GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462 => generated 1358 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:09:34.873983 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-2554a536-e060-4d03-9ab8-2953361202f0 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:09:34.874589 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-2554a536-e060-4d03-9ab8-2953361202f0 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] [instance: f7970ad9-31b5-4946-b689-d7865b3b6462] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:09:34.881497 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2554a536-e060-4d03-9ab8-2953361202f0 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:09:34.882326 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2554a536-e060-4d03-9ab8-2953361202f0 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:09:34.883308 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2554a536-e060-4d03-9ab8-2953361202f0 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:09:34.884077 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2554a536-e060-4d03-9ab8-2953361202f0 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:09:34.884568 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2554a536-e060-4d03-9ab8-2953361202f0 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:09:34.885013 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-2554a536-e060-4d03-9ab8-2953361202f0 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:09:35.024022 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-2554a536-e060-4d03-9ab8-2953361202f0 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811744d2a884e119076cde1b96f4846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192b8e73733046a188480d27a9092022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:09:35.033561 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-2554a536-e060-4d03-9ab8-2953361202f0 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] 10.222.0.59 "GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462" status: 200 len: 1358 microversion: 2.1 time: 0.163412 Aug 26 01:09:35.034266 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 572/1148] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:09:34 2022] GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:09:36.055414 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-20c7c0ad-5e35-4fa1-8936-9370476f5f15 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:09:36.057202 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-20c7c0ad-5e35-4fa1-8936-9370476f5f15 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] [instance: f7970ad9-31b5-4946-b689-d7865b3b6462] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:09:36.064822 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-20c7c0ad-5e35-4fa1-8936-9370476f5f15 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:09:36.065275 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-20c7c0ad-5e35-4fa1-8936-9370476f5f15 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:09:36.065714 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-20c7c0ad-5e35-4fa1-8936-9370476f5f15 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:09:36.066424 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-20c7c0ad-5e35-4fa1-8936-9370476f5f15 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:09:36.066878 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-20c7c0ad-5e35-4fa1-8936-9370476f5f15 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:09:36.067306 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-20c7c0ad-5e35-4fa1-8936-9370476f5f15 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:09:36.483430 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-20c7c0ad-5e35-4fa1-8936-9370476f5f15 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811744d2a884e119076cde1b96f4846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192b8e73733046a188480d27a9092022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:09:36.491564 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-20c7c0ad-5e35-4fa1-8936-9370476f5f15 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] 10.222.0.59 "GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462" status: 200 len: 1358 microversion: 2.1 time: 0.440337 Aug 26 01:09:36.492694 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 577/1149] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:09:36 2022] GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462 => generated 1358 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:09:37.513000 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-4c758c8c-a0a4-401f-86f6-8ae702b44ce6 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:09:37.513589 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-4c758c8c-a0a4-401f-86f6-8ae702b44ce6 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] [instance: f7970ad9-31b5-4946-b689-d7865b3b6462] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:09:37.520221 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4c758c8c-a0a4-401f-86f6-8ae702b44ce6 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:09:37.520732 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4c758c8c-a0a4-401f-86f6-8ae702b44ce6 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:09:37.521167 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4c758c8c-a0a4-401f-86f6-8ae702b44ce6 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:09:37.521864 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4c758c8c-a0a4-401f-86f6-8ae702b44ce6 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:09:37.522339 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4c758c8c-a0a4-401f-86f6-8ae702b44ce6 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:09:37.522834 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4c758c8c-a0a4-401f-86f6-8ae702b44ce6 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:09:37.663518 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-4c758c8c-a0a4-401f-86f6-8ae702b44ce6 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811744d2a884e119076cde1b96f4846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192b8e73733046a188480d27a9092022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:09:37.672193 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-4c758c8c-a0a4-401f-86f6-8ae702b44ce6 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] 10.222.0.59 "GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462" status: 200 len: 1358 microversion: 2.1 time: 0.163018 Aug 26 01:09:37.675962 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 573/1150] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:09:37 2022] GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:09:38.692639 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-34bc2f79-c10a-407b-97a4-569efbae6e5d tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:09:38.693199 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-34bc2f79-c10a-407b-97a4-569efbae6e5d tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] [instance: f7970ad9-31b5-4946-b689-d7865b3b6462] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:09:38.700813 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-34bc2f79-c10a-407b-97a4-569efbae6e5d tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:09:38.701381 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-34bc2f79-c10a-407b-97a4-569efbae6e5d tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:09:38.701825 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-34bc2f79-c10a-407b-97a4-569efbae6e5d tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:09:38.702531 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-34bc2f79-c10a-407b-97a4-569efbae6e5d tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:09:38.702987 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-34bc2f79-c10a-407b-97a4-569efbae6e5d tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:09:38.703589 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-34bc2f79-c10a-407b-97a4-569efbae6e5d tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:09:38.842150 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-34bc2f79-c10a-407b-97a4-569efbae6e5d tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811744d2a884e119076cde1b96f4846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192b8e73733046a188480d27a9092022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:09:38.850053 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-34bc2f79-c10a-407b-97a4-569efbae6e5d tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] 10.222.0.59 "GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462" status: 200 len: 1358 microversion: 2.1 time: 0.161350 Aug 26 01:09:38.850962 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 578/1151] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:09:38 2022] GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:09:39.871405 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-c9ba888e-d2bb-4298-812b-d1f1ece763ba tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:09:39.872124 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-c9ba888e-d2bb-4298-812b-d1f1ece763ba tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] [instance: f7970ad9-31b5-4946-b689-d7865b3b6462] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:09:39.878988 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c9ba888e-d2bb-4298-812b-d1f1ece763ba tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:09:39.879498 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c9ba888e-d2bb-4298-812b-d1f1ece763ba tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:09:39.882287 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c9ba888e-d2bb-4298-812b-d1f1ece763ba tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:09:39.882287 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c9ba888e-d2bb-4298-812b-d1f1ece763ba tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:09:39.882287 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c9ba888e-d2bb-4298-812b-d1f1ece763ba tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:09:39.882287 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-c9ba888e-d2bb-4298-812b-d1f1ece763ba tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:09:40.020988 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-c9ba888e-d2bb-4298-812b-d1f1ece763ba tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811744d2a884e119076cde1b96f4846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192b8e73733046a188480d27a9092022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:09:40.029280 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-c9ba888e-d2bb-4298-812b-d1f1ece763ba tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] 10.222.0.59 "GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462" status: 200 len: 1358 microversion: 2.1 time: 0.161816 Aug 26 01:09:40.030607 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 574/1152] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:09:39 2022] GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:09:41.050971 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-7d9bd570-37bb-4365-b525-8eb362f61a9f tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:09:41.051584 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-7d9bd570-37bb-4365-b525-8eb362f61a9f tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] [instance: f7970ad9-31b5-4946-b689-d7865b3b6462] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:09:41.053796 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell0:SELECT=2 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:09:41.058650 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-7d9bd570-37bb-4365-b525-8eb362f61a9f tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:09:41.062900 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-7d9bd570-37bb-4365-b525-8eb362f61a9f tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:09:41.062900 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-7d9bd570-37bb-4365-b525-8eb362f61a9f tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:09:41.062900 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-7d9bd570-37bb-4365-b525-8eb362f61a9f tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:09:41.062900 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-7d9bd570-37bb-4365-b525-8eb362f61a9f tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:09:41.063330 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-7d9bd570-37bb-4365-b525-8eb362f61a9f tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:09:41.190851 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-7d9bd570-37bb-4365-b525-8eb362f61a9f tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811744d2a884e119076cde1b96f4846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192b8e73733046a188480d27a9092022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:09:41.199013 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-7d9bd570-37bb-4365-b525-8eb362f61a9f tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] 10.222.0.59 "GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462" status: 200 len: 1358 microversion: 2.1 time: 0.152025 Aug 26 01:09:41.199562 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 579/1153] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:09:41 2022] GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:09:42.050022 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell0:SELECT=6 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:09:42.111928 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [req-2db76fb9-059c-47c7-9d06-cfa75c88815f req-27ffd845-f74e-44cf-bd6d-4069dc1c44c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7970ad9-31b5-4946-b689-d7865b3b6462", "tag": "a70ffa6d-967c-4bfc-8ada-dab1ddb2116d"}]} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:09:42.121702 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-2db76fb9-059c-47c7-9d06-cfa75c88815f req-27ffd845-f74e-44cf-bd6d-4069dc1c44c7 service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:09:42.124435 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-2db76fb9-059c-47c7-9d06-cfa75c88815f req-27ffd845-f74e-44cf-bd6d-4069dc1c44c7 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:09:42.124435 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-2db76fb9-059c-47c7-9d06-cfa75c88815f req-27ffd845-f74e-44cf-bd6d-4069dc1c44c7 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:09:42.134299 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.compute.server_external_events [req-2db76fb9-059c-47c7-9d06-cfa75c88815f req-27ffd845-f74e-44cf-bd6d-4069dc1c44c7 service nova] Creating event network-changed:a70ffa6d-967c-4bfc-8ada-dab1ddb2116d for instance f7970ad9-31b5-4946-b689-d7865b3b6462 on hv-cinder-83538 Aug 26 01:09:42.139235 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [req-2db76fb9-059c-47c7-9d06-cfa75c88815f req-27ffd845-f74e-44cf-bd6d-4069dc1c44c7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093632 Aug 26 01:09:42.139878 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 575/1154] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 01:09:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:09:42.219953 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-1f9096fb-4e7b-4f1a-8bb7-d7c13c1b4cd8 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:09:42.220573 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-1f9096fb-4e7b-4f1a-8bb7-d7c13c1b4cd8 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] [instance: f7970ad9-31b5-4946-b689-d7865b3b6462] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:09:42.222343 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell0:SELECT=8 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:09:42.227453 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1f9096fb-4e7b-4f1a-8bb7-d7c13c1b4cd8 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:09:42.228209 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1f9096fb-4e7b-4f1a-8bb7-d7c13c1b4cd8 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:09:42.233206 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1f9096fb-4e7b-4f1a-8bb7-d7c13c1b4cd8 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:09:42.233206 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1f9096fb-4e7b-4f1a-8bb7-d7c13c1b4cd8 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:09:42.233206 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1f9096fb-4e7b-4f1a-8bb7-d7c13c1b4cd8 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:09:42.233206 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-1f9096fb-4e7b-4f1a-8bb7-d7c13c1b4cd8 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:09:42.463196 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-1f9096fb-4e7b-4f1a-8bb7-d7c13c1b4cd8 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811744d2a884e119076cde1b96f4846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192b8e73733046a188480d27a9092022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:09:42.471259 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-1f9096fb-4e7b-4f1a-8bb7-d7c13c1b4cd8 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] 10.222.0.59 "GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462" status: 200 len: 1358 microversion: 2.1 time: 0.255134 Aug 26 01:09:42.471762 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 580/1155] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:09:42 2022] GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462 => generated 1358 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:09:43.492700 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-3d3d2e5c-721f-44c8-a4e7-916ee21065bc tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:09:43.493320 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-3d3d2e5c-721f-44c8-a4e7-916ee21065bc tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] [instance: f7970ad9-31b5-4946-b689-d7865b3b6462] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:09:43.499585 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3d3d2e5c-721f-44c8-a4e7-916ee21065bc tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:09:43.500054 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3d3d2e5c-721f-44c8-a4e7-916ee21065bc tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:09:43.500500 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3d3d2e5c-721f-44c8-a4e7-916ee21065bc tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:09:43.501173 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3d3d2e5c-721f-44c8-a4e7-916ee21065bc tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:09:43.501613 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3d3d2e5c-721f-44c8-a4e7-916ee21065bc tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:09:43.502029 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3d3d2e5c-721f-44c8-a4e7-916ee21065bc tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:09:43.628891 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-3d3d2e5c-721f-44c8-a4e7-916ee21065bc tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811744d2a884e119076cde1b96f4846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192b8e73733046a188480d27a9092022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:09:43.637042 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-3d3d2e5c-721f-44c8-a4e7-916ee21065bc tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] 10.222.0.59 "GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462" status: 200 len: 1358 microversion: 2.1 time: 0.149506 Aug 26 01:09:43.637709 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 576/1156] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:09:43 2022] GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:09:44.658976 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-3bc3d043-45d1-43c4-91a1-af13daeddd40 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:09:44.659590 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-3bc3d043-45d1-43c4-91a1-af13daeddd40 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] [instance: f7970ad9-31b5-4946-b689-d7865b3b6462] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:09:44.667791 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3bc3d043-45d1-43c4-91a1-af13daeddd40 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:09:44.668271 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3bc3d043-45d1-43c4-91a1-af13daeddd40 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:09:44.668762 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3bc3d043-45d1-43c4-91a1-af13daeddd40 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:09:44.669478 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3bc3d043-45d1-43c4-91a1-af13daeddd40 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:09:44.669922 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3bc3d043-45d1-43c4-91a1-af13daeddd40 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:09:44.670341 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3bc3d043-45d1-43c4-91a1-af13daeddd40 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:09:44.802079 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-3bc3d043-45d1-43c4-91a1-af13daeddd40 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811744d2a884e119076cde1b96f4846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192b8e73733046a188480d27a9092022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:09:44.806095 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-3bc3d043-45d1-43c4-91a1-af13daeddd40 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] 10.222.0.59 "GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462" status: 200 len: 1358 microversion: 2.1 time: 0.151032 Aug 26 01:09:44.806652 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 581/1157] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:09:44 2022] GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:09:45.826055 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-47c03609-9a0a-4d9a-b5ce-039626e60f35 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:09:45.826696 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-47c03609-9a0a-4d9a-b5ce-039626e60f35 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] [instance: f7970ad9-31b5-4946-b689-d7865b3b6462] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:09:45.833059 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-47c03609-9a0a-4d9a-b5ce-039626e60f35 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:09:45.833538 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-47c03609-9a0a-4d9a-b5ce-039626e60f35 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:09:45.833971 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-47c03609-9a0a-4d9a-b5ce-039626e60f35 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:09:45.834652 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-47c03609-9a0a-4d9a-b5ce-039626e60f35 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:09:45.835156 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-47c03609-9a0a-4d9a-b5ce-039626e60f35 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:09:45.835836 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-47c03609-9a0a-4d9a-b5ce-039626e60f35 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:09:45.988168 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-47c03609-9a0a-4d9a-b5ce-039626e60f35 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811744d2a884e119076cde1b96f4846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192b8e73733046a188480d27a9092022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:09:45.995935 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-47c03609-9a0a-4d9a-b5ce-039626e60f35 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] 10.222.0.59 "GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462" status: 200 len: 1358 microversion: 2.1 time: 0.173729 Aug 26 01:09:45.996514 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 577/1158] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:09:45 2022] GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:09:47.017643 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-b382f55e-dca5-4b96-bc1a-023f3d97ee60 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:09:47.018251 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-b382f55e-dca5-4b96-bc1a-023f3d97ee60 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] [instance: f7970ad9-31b5-4946-b689-d7865b3b6462] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:09:47.025447 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b382f55e-dca5-4b96-bc1a-023f3d97ee60 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:09:47.025930 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b382f55e-dca5-4b96-bc1a-023f3d97ee60 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:09:47.026363 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b382f55e-dca5-4b96-bc1a-023f3d97ee60 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:09:47.027049 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b382f55e-dca5-4b96-bc1a-023f3d97ee60 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:09:47.027500 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b382f55e-dca5-4b96-bc1a-023f3d97ee60 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:09:47.027925 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b382f55e-dca5-4b96-bc1a-023f3d97ee60 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:09:47.160770 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-b382f55e-dca5-4b96-bc1a-023f3d97ee60 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811744d2a884e119076cde1b96f4846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192b8e73733046a188480d27a9092022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:09:47.168663 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-b382f55e-dca5-4b96-bc1a-023f3d97ee60 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] 10.222.0.59 "GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462" status: 200 len: 1358 microversion: 2.1 time: 0.154982 Aug 26 01:09:47.169222 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 582/1159] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:09:47 2022] GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:09:47.548070 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [req-5ad99c5a-430e-4c77-950d-cffa4f8dfa79 req-084b93f3-9d5b-440a-89a5-48e0b3849f8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7970ad9-31b5-4946-b689-d7865b3b6462", "name": "network-vif-plugged", "status": "completed", "tag": "a70ffa6d-967c-4bfc-8ada-dab1ddb2116d"}]} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:09:47.557695 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-5ad99c5a-430e-4c77-950d-cffa4f8dfa79 req-084b93f3-9d5b-440a-89a5-48e0b3849f8a service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:09:47.558175 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-5ad99c5a-430e-4c77-950d-cffa4f8dfa79 req-084b93f3-9d5b-440a-89a5-48e0b3849f8a service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:09:47.558604 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-5ad99c5a-430e-4c77-950d-cffa4f8dfa79 req-084b93f3-9d5b-440a-89a5-48e0b3849f8a service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:09:47.569938 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.compute.server_external_events [req-5ad99c5a-430e-4c77-950d-cffa4f8dfa79 req-084b93f3-9d5b-440a-89a5-48e0b3849f8a service nova] Creating event network-vif-plugged:a70ffa6d-967c-4bfc-8ada-dab1ddb2116d for instance f7970ad9-31b5-4946-b689-d7865b3b6462 on hv-cinder-83538 Aug 26 01:09:47.575823 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [req-5ad99c5a-430e-4c77-950d-cffa4f8dfa79 req-084b93f3-9d5b-440a-89a5-48e0b3849f8a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090366 Aug 26 01:09:47.577149 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 578/1160] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 01:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:09:48.189392 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-3053480e-5b22-43c0-8e6e-c2bbff3ab223 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:09:48.190177 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-3053480e-5b22-43c0-8e6e-c2bbff3ab223 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] [instance: f7970ad9-31b5-4946-b689-d7865b3b6462] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:09:48.196625 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3053480e-5b22-43c0-8e6e-c2bbff3ab223 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:09:48.197121 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3053480e-5b22-43c0-8e6e-c2bbff3ab223 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:09:48.197555 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3053480e-5b22-43c0-8e6e-c2bbff3ab223 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:09:48.198265 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3053480e-5b22-43c0-8e6e-c2bbff3ab223 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:09:48.198722 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3053480e-5b22-43c0-8e6e-c2bbff3ab223 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:09:48.199141 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-3053480e-5b22-43c0-8e6e-c2bbff3ab223 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:09:48.334071 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-3053480e-5b22-43c0-8e6e-c2bbff3ab223 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811744d2a884e119076cde1b96f4846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192b8e73733046a188480d27a9092022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:09:48.343767 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-3053480e-5b22-43c0-8e6e-c2bbff3ab223 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] 10.222.0.59 "GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462" status: 200 len: 1358 microversion: 2.1 time: 0.158485 Aug 26 01:09:48.344329 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 583/1161] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:09:48 2022] GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:09:49.365841 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-61215595-47a8-49e6-9864-7642999ff7ca tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:09:49.366532 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-61215595-47a8-49e6-9864-7642999ff7ca tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] [instance: f7970ad9-31b5-4946-b689-d7865b3b6462] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:09:49.372802 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-61215595-47a8-49e6-9864-7642999ff7ca tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:09:49.373283 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-61215595-47a8-49e6-9864-7642999ff7ca tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:09:49.373717 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-61215595-47a8-49e6-9864-7642999ff7ca tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:09:49.374434 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-61215595-47a8-49e6-9864-7642999ff7ca tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:09:49.374889 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-61215595-47a8-49e6-9864-7642999ff7ca tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:09:49.375308 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-61215595-47a8-49e6-9864-7642999ff7ca tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:09:49.503606 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-61215595-47a8-49e6-9864-7642999ff7ca tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811744d2a884e119076cde1b96f4846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192b8e73733046a188480d27a9092022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:09:49.511693 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-61215595-47a8-49e6-9864-7642999ff7ca tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] 10.222.0.59 "GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462" status: 200 len: 1548 microversion: 2.1 time: 0.150596 Aug 26 01:09:49.512253 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 579/1162] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:09:49 2022] GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462 => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:09:49.531631 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-878823f6-beb4-428a-9ad1-82537f9c3f01 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:09:49.532264 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-878823f6-beb4-428a-9ad1-82537f9c3f01 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] [instance: f7970ad9-31b5-4946-b689-d7865b3b6462] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:09:49.538880 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-878823f6-beb4-428a-9ad1-82537f9c3f01 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:09:49.539356 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-878823f6-beb4-428a-9ad1-82537f9c3f01 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:09:49.539786 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-878823f6-beb4-428a-9ad1-82537f9c3f01 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:09:49.540486 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-878823f6-beb4-428a-9ad1-82537f9c3f01 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:09:49.540937 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-878823f6-beb4-428a-9ad1-82537f9c3f01 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:09:49.541358 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-878823f6-beb4-428a-9ad1-82537f9c3f01 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:09:49.666078 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-878823f6-beb4-428a-9ad1-82537f9c3f01 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811744d2a884e119076cde1b96f4846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192b8e73733046a188480d27a9092022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:09:49.673811 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-878823f6-beb4-428a-9ad1-82537f9c3f01 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] 10.222.0.59 "GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462" status: 200 len: 1548 microversion: 2.1 time: 0.145981 Aug 26 01:09:49.674369 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 584/1163] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:09:49 2022] GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462 => generated 1548 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:09:49.693933 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-cbfee146-4c08-47bd-9e16-932adcc98f74 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:09:49.699332 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-cbfee146-4c08-47bd-9e16-932adcc98f74 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e811744d2a884e119076cde1b96f4846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192b8e73733046a188480d27a9092022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:09:49.700093 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-cbfee146-4c08-47bd-9e16-932adcc98f74 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Searching by: {'deleted': False, 'project_id': '192b8e73733046a188480d27a9092022'} {{(pid=127565) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 26 01:09:49.706698 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-cbfee146-4c08-47bd-9e16-932adcc98f74 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:09:49.707107 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-cbfee146-4c08-47bd-9e16-932adcc98f74 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:09:49.707535 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-cbfee146-4c08-47bd-9e16-932adcc98f74 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:09:49.708262 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-cbfee146-4c08-47bd-9e16-932adcc98f74 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:09:49.708721 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-cbfee146-4c08-47bd-9e16-932adcc98f74 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:09:49.709144 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-cbfee146-4c08-47bd-9e16-932adcc98f74 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:09:49.797166 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.multi_cell_list [None req-cbfee146-4c08-47bd-9e16-932adcc98f74 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127565) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 26 01:09:49.889467 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-cbfee146-4c08-47bd-9e16-932adcc98f74 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] 10.222.0.59 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.199140 Aug 26 01:09:49.890061 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 580/1164] 10.222.0.59 () {58 vars in 1125 bytes} [Fri Aug 26 01:09:49 2022] GET /compute/v2.1/servers => generated 343 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:09:49.902063 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-679fc3aa-254e-44b8-9e4c-d72a726ddb0f tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:09:49.902672 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-679fc3aa-254e-44b8-9e4c-d72a726ddb0f tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] [instance: f7970ad9-31b5-4946-b689-d7865b3b6462] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:09:49.908660 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-679fc3aa-254e-44b8-9e4c-d72a726ddb0f tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:09:49.912135 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-679fc3aa-254e-44b8-9e4c-d72a726ddb0f tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:09:49.912135 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-679fc3aa-254e-44b8-9e4c-d72a726ddb0f tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:09:49.912135 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-679fc3aa-254e-44b8-9e4c-d72a726ddb0f tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:09:49.912135 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-679fc3aa-254e-44b8-9e4c-d72a726ddb0f tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:09:49.912837 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-679fc3aa-254e-44b8-9e4c-d72a726ddb0f tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:09:50.044107 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-679fc3aa-254e-44b8-9e4c-d72a726ddb0f tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811744d2a884e119076cde1b96f4846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192b8e73733046a188480d27a9092022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:09:50.051695 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-679fc3aa-254e-44b8-9e4c-d72a726ddb0f tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] 10.222.0.59 "GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462" status: 200 len: 1548 microversion: 2.1 time: 0.154095 Aug 26 01:09:50.052259 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 585/1165] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:09:49 2022] GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462 => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:09:51.925838 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-19578557-92a2-453b-9cfe-b32d24e4231a tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "81eb82f7-a18b-48b3-b348-c95f8be953cc"}} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:09:51.928258 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-19578557-92a2-453b-9cfe-b32d24e4231a tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] [instance: f7970ad9-31b5-4946-b689-d7865b3b6462] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:09:51.935336 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-19578557-92a2-453b-9cfe-b32d24e4231a tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:09:51.935813 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-19578557-92a2-453b-9cfe-b32d24e4231a tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:09:51.936244 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-19578557-92a2-453b-9cfe-b32d24e4231a tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:09:51.936962 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-19578557-92a2-453b-9cfe-b32d24e4231a tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:09:51.937409 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-19578557-92a2-453b-9cfe-b32d24e4231a tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:09:51.937831 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-19578557-92a2-453b-9cfe-b32d24e4231a tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:09:52.583032 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-19578557-92a2-453b-9cfe-b32d24e4231a tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] 10.222.0.59 "POST /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.660803 Aug 26 01:09:52.583661 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 581/1166] 10.222.0.59 () {60 vars in 1323 bytes} [Fri Aug 26 01:09:51 2022] POST /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462/os-volume_attachments => generated 194 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:10:00.162322 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-d3d1980e-e974-4c89-846f-cb98fe3da3c8 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:10:00.163217 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-d3d1980e-e974-4c89-846f-cb98fe3da3c8 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] [instance: f7970ad9-31b5-4946-b689-d7865b3b6462] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:10:00.165399 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:10:00.166038 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell1:SELECT=62 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:10:00.170697 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-d3d1980e-e974-4c89-846f-cb98fe3da3c8 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:10:00.171167 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-d3d1980e-e974-4c89-846f-cb98fe3da3c8 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:10:00.171596 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-d3d1980e-e974-4c89-846f-cb98fe3da3c8 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:10:00.172274 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-d3d1980e-e974-4c89-846f-cb98fe3da3c8 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:10:00.172760 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-d3d1980e-e974-4c89-846f-cb98fe3da3c8 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:10:00.173173 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-d3d1980e-e974-4c89-846f-cb98fe3da3c8 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:10:00.299942 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-d3d1980e-e974-4c89-846f-cb98fe3da3c8 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811744d2a884e119076cde1b96f4846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192b8e73733046a188480d27a9092022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:10:00.308643 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-d3d1980e-e974-4c89-846f-cb98fe3da3c8 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] 10.222.0.59 "GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462" status: 200 len: 1594 microversion: 2.1 time: 0.150110 Aug 26 01:10:00.309206 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 586/1167] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:10:00 2022] GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462 => generated 1594 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:10:02.920989 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [req-7cee996b-fb5f-4568-b013-0d4214af351c req-5353d80a-afd7-450e-992a-e547dbc036e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7970ad9-31b5-4946-b689-d7865b3b6462", "tag": "a70ffa6d-967c-4bfc-8ada-dab1ddb2116d"}]} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:10:02.931178 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell0:SELECT=2 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:10:02.932105 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:10:02.932928 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:10:02.935212 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-7cee996b-fb5f-4568-b013-0d4214af351c req-5353d80a-afd7-450e-992a-e547dbc036e5 service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:10:02.935692 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-7cee996b-fb5f-4568-b013-0d4214af351c req-5353d80a-afd7-450e-992a-e547dbc036e5 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:10:02.936118 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-7cee996b-fb5f-4568-b013-0d4214af351c req-5353d80a-afd7-450e-992a-e547dbc036e5 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:10:02.950909 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.compute.server_external_events [req-7cee996b-fb5f-4568-b013-0d4214af351c req-5353d80a-afd7-450e-992a-e547dbc036e5 service nova] Creating event network-changed:a70ffa6d-967c-4bfc-8ada-dab1ddb2116d for instance f7970ad9-31b5-4946-b689-d7865b3b6462 on hv-cinder-83538 Aug 26 01:10:02.956035 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [req-7cee996b-fb5f-4568-b013-0d4214af351c req-5353d80a-afd7-450e-992a-e547dbc036e5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039226 Aug 26 01:10:02.956914 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 582/1168] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 01:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:10:05.883771 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-b682ca4d-90b5-4224-a56f-e1dc7c4a62a0 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1184488971"}} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:10:05.884307 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-b682ca4d-90b5-4224-a56f-e1dc7c4a62a0 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] [instance: f7970ad9-31b5-4946-b689-d7865b3b6462] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:10:05.890847 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b682ca4d-90b5-4224-a56f-e1dc7c4a62a0 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:10:05.891332 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b682ca4d-90b5-4224-a56f-e1dc7c4a62a0 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:10:05.891766 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b682ca4d-90b5-4224-a56f-e1dc7c4a62a0 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:10:05.892455 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b682ca4d-90b5-4224-a56f-e1dc7c4a62a0 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:10:05.892933 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b682ca4d-90b5-4224-a56f-e1dc7c4a62a0 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:10:05.893360 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-b682ca4d-90b5-4224-a56f-e1dc7c4a62a0 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:10:06.020782 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.network.security_group_api [None req-b682ca4d-90b5-4224-a56f-e1dc7c4a62a0 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Adding security group f5047fd4-3d58-4413-aaa3-4697f5943fd7 to port a70ffa6d-967c-4bfc-8ada-dab1ddb2116d Aug 26 01:10:06.397710 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-b682ca4d-90b5-4224-a56f-e1dc7c4a62a0 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] 10.222.0.59 "POST /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462/action" status: 202 len: 0 microversion: 2.1 time: 0.518275 Aug 26 01:10:06.398317 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 587/1169] 10.222.0.59 () {60 vars in 1278 bytes} [Fri Aug 26 01:10:05 2022] POST /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462/action => generated 0 bytes in 520 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 26 01:10:06.406995 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [req-e353736d-f7d6-41ba-9a68-cd1aefe588f1 req-d3404ac7-cef2-4c79-97d0-c6cdefcb54cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7970ad9-31b5-4946-b689-d7865b3b6462", "tag": "a70ffa6d-967c-4bfc-8ada-dab1ddb2116d"}]} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:10:06.411014 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-bc9ab666-b370-49b4-971d-1e479268316c tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:10:06.411817 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-bc9ab666-b370-49b4-971d-1e479268316c tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] [instance: f7970ad9-31b5-4946-b689-d7865b3b6462] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:10:06.418012 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-e353736d-f7d6-41ba-9a68-cd1aefe588f1 req-d3404ac7-cef2-4c79-97d0-c6cdefcb54cd service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:10:06.418529 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-e353736d-f7d6-41ba-9a68-cd1aefe588f1 req-d3404ac7-cef2-4c79-97d0-c6cdefcb54cd service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:10:06.419581 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-e353736d-f7d6-41ba-9a68-cd1aefe588f1 req-d3404ac7-cef2-4c79-97d0-c6cdefcb54cd service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:10:06.422020 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-bc9ab666-b370-49b4-971d-1e479268316c tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:10:06.422511 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-bc9ab666-b370-49b4-971d-1e479268316c tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:10:06.422950 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-bc9ab666-b370-49b4-971d-1e479268316c tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:10:06.423650 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-bc9ab666-b370-49b4-971d-1e479268316c tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:10:06.424120 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-bc9ab666-b370-49b4-971d-1e479268316c tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:10:06.424641 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-bc9ab666-b370-49b4-971d-1e479268316c tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:10:06.436623 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.compute.server_external_events [req-e353736d-f7d6-41ba-9a68-cd1aefe588f1 req-d3404ac7-cef2-4c79-97d0-c6cdefcb54cd service nova] Creating event network-changed:a70ffa6d-967c-4bfc-8ada-dab1ddb2116d for instance f7970ad9-31b5-4946-b689-d7865b3b6462 on hv-cinder-83538 Aug 26 01:10:06.444169 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [req-e353736d-f7d6-41ba-9a68-cd1aefe588f1 req-d3404ac7-cef2-4c79-97d0-c6cdefcb54cd service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038148 Aug 26 01:10:06.444169 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 588/1170] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 01:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:10:06.593439 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-bc9ab666-b370-49b4-971d-1e479268316c tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811744d2a884e119076cde1b96f4846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192b8e73733046a188480d27a9092022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:10:06.603898 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-bc9ab666-b370-49b4-971d-1e479268316c tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] 10.222.0.59 "GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462" status: 200 len: 1759 microversion: 2.1 time: 0.199706 Aug 26 01:10:06.604745 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 583/1171] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:10:06 2022] GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462 => generated 1759 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:10:23.630238 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_api:SELECT=6 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:10:23.630984 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell1:SELECT=12 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:10:23.635149 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-87680d6c-9b48-4036-9687-eb3f0167a03e tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:10:23.637459 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-87680d6c-9b48-4036-9687-eb3f0167a03e tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] [instance: f7970ad9-31b5-4946-b689-d7865b3b6462] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:10:23.643951 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-87680d6c-9b48-4036-9687-eb3f0167a03e tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:10:23.645016 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-87680d6c-9b48-4036-9687-eb3f0167a03e tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:10:23.645016 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-87680d6c-9b48-4036-9687-eb3f0167a03e tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:10:23.645542 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-87680d6c-9b48-4036-9687-eb3f0167a03e tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:10:23.645993 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-87680d6c-9b48-4036-9687-eb3f0167a03e tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:10:23.646416 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-87680d6c-9b48-4036-9687-eb3f0167a03e tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:10:23.874175 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-87680d6c-9b48-4036-9687-eb3f0167a03e tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] 10.222.0.59 "POST /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462/action" status: 202 len: 0 microversion: 2.1 time: 0.245348 Aug 26 01:10:23.874841 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 589/1172] 10.222.0.59 () {60 vars in 1278 bytes} [Fri Aug 26 01:10:23 2022] POST /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 01:10:23.882887 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-6eb75173-794d-4b85-9ddd-219c0cf2d390 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:10:23.883859 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-6eb75173-794d-4b85-9ddd-219c0cf2d390 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] [instance: f7970ad9-31b5-4946-b689-d7865b3b6462] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:10:23.886243 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_api:SELECT=4 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:10:23.886900 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell1:SELECT=8 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:10:23.892202 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6eb75173-794d-4b85-9ddd-219c0cf2d390 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:10:23.892737 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6eb75173-794d-4b85-9ddd-219c0cf2d390 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:10:23.893179 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6eb75173-794d-4b85-9ddd-219c0cf2d390 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:10:23.893879 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6eb75173-794d-4b85-9ddd-219c0cf2d390 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:10:23.894330 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6eb75173-794d-4b85-9ddd-219c0cf2d390 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:10:23.894755 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-6eb75173-794d-4b85-9ddd-219c0cf2d390 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:10:24.040965 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-6eb75173-794d-4b85-9ddd-219c0cf2d390 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811744d2a884e119076cde1b96f4846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192b8e73733046a188480d27a9092022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:10:24.049191 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-6eb75173-794d-4b85-9ddd-219c0cf2d390 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] 10.222.0.59 "GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462" status: 200 len: 1751 microversion: 2.1 time: 0.170104 Aug 26 01:10:24.049760 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 584/1173] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:10:23 2022] GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462 => generated 1751 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:10:25.072326 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-75cc857c-fac6-444a-8600-37d3a44c4a1b tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:10:25.073104 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-75cc857c-fac6-444a-8600-37d3a44c4a1b tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] [instance: f7970ad9-31b5-4946-b689-d7865b3b6462] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:10:25.079346 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-75cc857c-fac6-444a-8600-37d3a44c4a1b tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:10:25.079822 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-75cc857c-fac6-444a-8600-37d3a44c4a1b tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:10:25.080251 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-75cc857c-fac6-444a-8600-37d3a44c4a1b tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:10:25.081039 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-75cc857c-fac6-444a-8600-37d3a44c4a1b tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:10:25.081482 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-75cc857c-fac6-444a-8600-37d3a44c4a1b tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:10:25.081903 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-75cc857c-fac6-444a-8600-37d3a44c4a1b tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:10:25.229057 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-75cc857c-fac6-444a-8600-37d3a44c4a1b tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811744d2a884e119076cde1b96f4846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192b8e73733046a188480d27a9092022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:10:25.237271 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-75cc857c-fac6-444a-8600-37d3a44c4a1b tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] 10.222.0.59 "GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462" status: 200 len: 1756 microversion: 2.1 time: 0.169900 Aug 26 01:10:25.237826 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 590/1174] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:10:25 2022] GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:10:26.258382 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-ac4b1d0e-0d1c-4d8e-9a5c-bd04aae6753f tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:10:26.258991 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-ac4b1d0e-0d1c-4d8e-9a5c-bd04aae6753f tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] [instance: f7970ad9-31b5-4946-b689-d7865b3b6462] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:10:26.265815 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ac4b1d0e-0d1c-4d8e-9a5c-bd04aae6753f tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:10:26.266291 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ac4b1d0e-0d1c-4d8e-9a5c-bd04aae6753f tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:10:26.266721 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ac4b1d0e-0d1c-4d8e-9a5c-bd04aae6753f tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:10:26.267984 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ac4b1d0e-0d1c-4d8e-9a5c-bd04aae6753f tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:10:26.268431 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ac4b1d0e-0d1c-4d8e-9a5c-bd04aae6753f tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:10:26.268878 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-ac4b1d0e-0d1c-4d8e-9a5c-bd04aae6753f tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:10:26.405141 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-ac4b1d0e-0d1c-4d8e-9a5c-bd04aae6753f tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811744d2a884e119076cde1b96f4846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192b8e73733046a188480d27a9092022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:10:26.413739 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-ac4b1d0e-0d1c-4d8e-9a5c-bd04aae6753f tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] 10.222.0.59 "GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462" status: 200 len: 1756 microversion: 2.1 time: 0.159221 Aug 26 01:10:26.414303 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 585/1175] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:10:26 2022] GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462 => generated 1756 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:10:27.435216 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-4c91df22-caf1-431a-9fdc-eed6eac5949f tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:10:27.435916 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-4c91df22-caf1-431a-9fdc-eed6eac5949f tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] [instance: f7970ad9-31b5-4946-b689-d7865b3b6462] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:10:27.442450 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-4c91df22-caf1-431a-9fdc-eed6eac5949f tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:10:27.442931 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-4c91df22-caf1-431a-9fdc-eed6eac5949f tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:10:27.443368 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-4c91df22-caf1-431a-9fdc-eed6eac5949f tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:10:27.444060 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-4c91df22-caf1-431a-9fdc-eed6eac5949f tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:10:27.444535 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-4c91df22-caf1-431a-9fdc-eed6eac5949f tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:10:27.444965 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-4c91df22-caf1-431a-9fdc-eed6eac5949f tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:10:27.585907 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-4c91df22-caf1-431a-9fdc-eed6eac5949f tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811744d2a884e119076cde1b96f4846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192b8e73733046a188480d27a9092022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:10:27.594148 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-4c91df22-caf1-431a-9fdc-eed6eac5949f tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] 10.222.0.59 "GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462" status: 200 len: 1756 microversion: 2.1 time: 0.162788 Aug 26 01:10:27.594767 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 591/1176] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:10:27 2022] GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:10:28.615736 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-5aed92e1-94e8-4e3f-8fe1-2838ced38195 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:10:28.616356 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-5aed92e1-94e8-4e3f-8fe1-2838ced38195 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] [instance: f7970ad9-31b5-4946-b689-d7865b3b6462] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:10:28.622932 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5aed92e1-94e8-4e3f-8fe1-2838ced38195 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:10:28.623416 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5aed92e1-94e8-4e3f-8fe1-2838ced38195 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:10:28.623859 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5aed92e1-94e8-4e3f-8fe1-2838ced38195 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:10:28.624570 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5aed92e1-94e8-4e3f-8fe1-2838ced38195 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:10:28.625020 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5aed92e1-94e8-4e3f-8fe1-2838ced38195 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:10:28.625446 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5aed92e1-94e8-4e3f-8fe1-2838ced38195 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:10:28.766144 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-5aed92e1-94e8-4e3f-8fe1-2838ced38195 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811744d2a884e119076cde1b96f4846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192b8e73733046a188480d27a9092022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:10:28.774323 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-5aed92e1-94e8-4e3f-8fe1-2838ced38195 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] 10.222.0.59 "GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462" status: 200 len: 1756 microversion: 2.1 time: 0.162477 Aug 26 01:10:28.774891 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 586/1177] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:10:28 2022] GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:10:29.796684 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-52d65bd3-abee-4993-840f-1cdabda88b7c tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:10:29.797246 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-52d65bd3-abee-4993-840f-1cdabda88b7c tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] [instance: f7970ad9-31b5-4946-b689-d7865b3b6462] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:10:29.804102 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-52d65bd3-abee-4993-840f-1cdabda88b7c tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:10:29.804614 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-52d65bd3-abee-4993-840f-1cdabda88b7c tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:10:29.805053 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-52d65bd3-abee-4993-840f-1cdabda88b7c tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:10:29.805744 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-52d65bd3-abee-4993-840f-1cdabda88b7c tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:10:29.806196 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-52d65bd3-abee-4993-840f-1cdabda88b7c tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:10:29.806619 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-52d65bd3-abee-4993-840f-1cdabda88b7c tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:10:29.947239 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-52d65bd3-abee-4993-840f-1cdabda88b7c tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811744d2a884e119076cde1b96f4846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192b8e73733046a188480d27a9092022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:10:29.955761 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-52d65bd3-abee-4993-840f-1cdabda88b7c tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] 10.222.0.59 "GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462" status: 200 len: 1756 microversion: 2.1 time: 0.162832 Aug 26 01:10:29.956324 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 592/1178] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:10:29 2022] GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:10:30.976720 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-9dee52dd-c2c6-4ed6-bb09-309e7a660b17 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:10:30.986723 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-9dee52dd-c2c6-4ed6-bb09-309e7a660b17 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] [instance: f7970ad9-31b5-4946-b689-d7865b3b6462] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:10:30.986723 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9dee52dd-c2c6-4ed6-bb09-309e7a660b17 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:10:30.986723 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9dee52dd-c2c6-4ed6-bb09-309e7a660b17 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:10:30.986723 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9dee52dd-c2c6-4ed6-bb09-309e7a660b17 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:10:30.987756 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9dee52dd-c2c6-4ed6-bb09-309e7a660b17 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:10:30.987756 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9dee52dd-c2c6-4ed6-bb09-309e7a660b17 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:10:30.987756 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9dee52dd-c2c6-4ed6-bb09-309e7a660b17 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:10:31.128350 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-9dee52dd-c2c6-4ed6-bb09-309e7a660b17 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811744d2a884e119076cde1b96f4846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192b8e73733046a188480d27a9092022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:10:31.136607 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-9dee52dd-c2c6-4ed6-bb09-309e7a660b17 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] 10.222.0.59 "GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462" status: 200 len: 1756 microversion: 2.1 time: 0.163773 Aug 26 01:10:31.137181 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 587/1179] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:10:30 2022] GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:10:32.157856 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-593b839a-c9cf-43b2-adf3-260737890504 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:10:32.159174 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-593b839a-c9cf-43b2-adf3-260737890504 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] [instance: f7970ad9-31b5-4946-b689-d7865b3b6462] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:10:32.165875 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-593b839a-c9cf-43b2-adf3-260737890504 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:10:32.166358 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-593b839a-c9cf-43b2-adf3-260737890504 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:10:32.166796 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-593b839a-c9cf-43b2-adf3-260737890504 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:10:32.167486 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-593b839a-c9cf-43b2-adf3-260737890504 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:10:32.167938 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-593b839a-c9cf-43b2-adf3-260737890504 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:10:32.168361 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-593b839a-c9cf-43b2-adf3-260737890504 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:10:32.316770 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-593b839a-c9cf-43b2-adf3-260737890504 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811744d2a884e119076cde1b96f4846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192b8e73733046a188480d27a9092022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:10:32.324994 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-593b839a-c9cf-43b2-adf3-260737890504 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] 10.222.0.59 "GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462" status: 200 len: 1756 microversion: 2.1 time: 0.170994 Aug 26 01:10:32.328610 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 593/1180] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:10:32 2022] GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:10:33.346004 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-aebc18e2-7cea-4d64-a7a1-5ef6d941fad5 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:10:33.347184 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-aebc18e2-7cea-4d64-a7a1-5ef6d941fad5 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] [instance: f7970ad9-31b5-4946-b689-d7865b3b6462] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:10:33.353645 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-aebc18e2-7cea-4d64-a7a1-5ef6d941fad5 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:10:33.362716 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-aebc18e2-7cea-4d64-a7a1-5ef6d941fad5 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:10:33.362716 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-aebc18e2-7cea-4d64-a7a1-5ef6d941fad5 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:10:33.362716 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-aebc18e2-7cea-4d64-a7a1-5ef6d941fad5 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:10:33.362716 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-aebc18e2-7cea-4d64-a7a1-5ef6d941fad5 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:10:33.363143 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-aebc18e2-7cea-4d64-a7a1-5ef6d941fad5 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:10:33.497186 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-aebc18e2-7cea-4d64-a7a1-5ef6d941fad5 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811744d2a884e119076cde1b96f4846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192b8e73733046a188480d27a9092022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:10:33.505394 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-aebc18e2-7cea-4d64-a7a1-5ef6d941fad5 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] 10.222.0.59 "GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462" status: 200 len: 1756 microversion: 2.1 time: 0.163230 Aug 26 01:10:33.505957 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 588/1181] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:10:33 2022] GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:10:34.526946 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-fdea8168-6d8f-4495-b854-511151bd9fed tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:10:34.527585 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-fdea8168-6d8f-4495-b854-511151bd9fed tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] [instance: f7970ad9-31b5-4946-b689-d7865b3b6462] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:10:34.534219 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fdea8168-6d8f-4495-b854-511151bd9fed tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:10:34.534689 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fdea8168-6d8f-4495-b854-511151bd9fed tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:10:34.535114 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fdea8168-6d8f-4495-b854-511151bd9fed tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:10:34.535797 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fdea8168-6d8f-4495-b854-511151bd9fed tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:10:34.536240 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fdea8168-6d8f-4495-b854-511151bd9fed tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:10:34.536686 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-fdea8168-6d8f-4495-b854-511151bd9fed tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:10:34.676749 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-fdea8168-6d8f-4495-b854-511151bd9fed tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811744d2a884e119076cde1b96f4846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192b8e73733046a188480d27a9092022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:10:34.685004 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-fdea8168-6d8f-4495-b854-511151bd9fed tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] 10.222.0.59 "GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462" status: 200 len: 1756 microversion: 2.1 time: 0.161946 Aug 26 01:10:34.685567 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 594/1182] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:10:34 2022] GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:10:35.705528 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-4634ea51-fc00-491d-8320-48041833800d tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:10:35.706080 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-4634ea51-fc00-491d-8320-48041833800d tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] [instance: f7970ad9-31b5-4946-b689-d7865b3b6462] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:10:35.712610 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4634ea51-fc00-491d-8320-48041833800d tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:10:35.713086 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4634ea51-fc00-491d-8320-48041833800d tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:10:35.713516 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4634ea51-fc00-491d-8320-48041833800d tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:10:35.714226 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4634ea51-fc00-491d-8320-48041833800d tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:10:35.714670 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4634ea51-fc00-491d-8320-48041833800d tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:10:35.715087 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4634ea51-fc00-491d-8320-48041833800d tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:10:35.860492 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-4634ea51-fc00-491d-8320-48041833800d tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811744d2a884e119076cde1b96f4846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192b8e73733046a188480d27a9092022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:10:35.869435 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-4634ea51-fc00-491d-8320-48041833800d tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] 10.222.0.59 "GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462" status: 200 len: 1756 microversion: 2.1 time: 0.167824 Aug 26 01:10:35.870042 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 589/1183] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:10:35 2022] GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:10:36.893148 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-bd6bc587-3003-4005-9af6-69c46133c4b8 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:10:36.893774 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-bd6bc587-3003-4005-9af6-69c46133c4b8 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] [instance: f7970ad9-31b5-4946-b689-d7865b3b6462] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:10:36.901571 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bd6bc587-3003-4005-9af6-69c46133c4b8 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:10:36.903173 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bd6bc587-3003-4005-9af6-69c46133c4b8 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:10:36.903617 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bd6bc587-3003-4005-9af6-69c46133c4b8 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:10:36.904316 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bd6bc587-3003-4005-9af6-69c46133c4b8 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:10:36.904818 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bd6bc587-3003-4005-9af6-69c46133c4b8 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:10:36.910577 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bd6bc587-3003-4005-9af6-69c46133c4b8 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:10:37.051602 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-bd6bc587-3003-4005-9af6-69c46133c4b8 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811744d2a884e119076cde1b96f4846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192b8e73733046a188480d27a9092022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:10:37.060018 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-bd6bc587-3003-4005-9af6-69c46133c4b8 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] 10.222.0.59 "GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462" status: 200 len: 1759 microversion: 2.1 time: 0.172382 Aug 26 01:10:37.060596 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 595/1184] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:10:36 2022] GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462 => generated 1759 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:11:09.309292 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-9f7bd3aa-885f-42b5-926b-584dfa2d2bbb tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1184488971"}} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:11:09.309923 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-9f7bd3aa-885f-42b5-926b-584dfa2d2bbb tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] [instance: f7970ad9-31b5-4946-b689-d7865b3b6462] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:11:09.312004 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_api:SELECT=12 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:11:09.312690 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG dbcounter [-] [127565] Writing DB stats nova_cell1:SELECT=36 {{(pid=127565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:11:09.317876 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9f7bd3aa-885f-42b5-926b-584dfa2d2bbb tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:11:09.318358 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9f7bd3aa-885f-42b5-926b-584dfa2d2bbb tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:11:09.318780 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9f7bd3aa-885f-42b5-926b-584dfa2d2bbb tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:11:09.319455 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9f7bd3aa-885f-42b5-926b-584dfa2d2bbb tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:11:09.319899 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9f7bd3aa-885f-42b5-926b-584dfa2d2bbb tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:11:09.320314 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-9f7bd3aa-885f-42b5-926b-584dfa2d2bbb tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:11:09.334921 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 26 01:11:09.335106 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Fri Aug 26 01:11:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462/action (ip 10.222.0.59) !!! Aug 26 01:11:09.449355 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.network.security_group_api [None req-9f7bd3aa-885f-42b5-926b-584dfa2d2bbb tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Removing security group f5047fd4-3d58-4413-aaa3-4697f5943fd7 from port a70ffa6d-967c-4bfc-8ada-dab1ddb2116d Aug 26 01:11:09.841164 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-9f7bd3aa-885f-42b5-926b-584dfa2d2bbb tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] 10.222.0.59 "POST /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462/action" status: 202 len: 0 microversion: 2.1 time: 0.535650 Aug 26 01:11:09.841918 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 590/1185] 10.222.0.59 () {60 vars in 1278 bytes} [Fri Aug 26 01:11:09 2022] POST /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462/action => generated 0 bytes in 537 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 01:11:09.874009 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_api:SELECT=14 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:11:09.879662 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG dbcounter [-] [127564] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:11:09.881307 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 26 01:11:09.881626 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Fri Aug 26 01:11:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.59) !!! Aug 26 01:11:09.945001 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [req-d3b2cc85-bcf9-423e-be1d-90be35e977f4 req-f14304be-20c5-48d1-b61c-c00fdea50623 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7970ad9-31b5-4946-b689-d7865b3b6462", "tag": "a70ffa6d-967c-4bfc-8ada-dab1ddb2116d"}]} {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:11:09.956906 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-d3b2cc85-bcf9-423e-be1d-90be35e977f4 req-f14304be-20c5-48d1-b61c-c00fdea50623 service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:11:09.957306 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-d3b2cc85-bcf9-423e-be1d-90be35e977f4 req-f14304be-20c5-48d1-b61c-c00fdea50623 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:11:09.958295 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [req-d3b2cc85-bcf9-423e-be1d-90be35e977f4 req-f14304be-20c5-48d1-b61c-c00fdea50623 service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:11:09.970172 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.compute.server_external_events [req-d3b2cc85-bcf9-423e-be1d-90be35e977f4 req-f14304be-20c5-48d1-b61c-c00fdea50623 service nova] Creating event network-changed:a70ffa6d-967c-4bfc-8ada-dab1ddb2116d for instance f7970ad9-31b5-4946-b689-d7865b3b6462 on hv-cinder-83538 Aug 26 01:11:09.975973 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [req-d3b2cc85-bcf9-423e-be1d-90be35e977f4 req-f14304be-20c5-48d1-b61c-c00fdea50623 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113390 Aug 26 01:11:09.976704 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 596/1186] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 01:11:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:11:10.989189 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-f6ef691b-7a6a-489e-9c52-4e79f621fcb1 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:11:10.989713 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-f6ef691b-7a6a-489e-9c52-4e79f621fcb1 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] [instance: f7970ad9-31b5-4946-b689-d7865b3b6462] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:11:10.995747 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f6ef691b-7a6a-489e-9c52-4e79f621fcb1 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:11:10.996231 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f6ef691b-7a6a-489e-9c52-4e79f621fcb1 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:11:10.996699 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f6ef691b-7a6a-489e-9c52-4e79f621fcb1 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:11:10.997388 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f6ef691b-7a6a-489e-9c52-4e79f621fcb1 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:11:10.997839 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f6ef691b-7a6a-489e-9c52-4e79f621fcb1 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:11:10.998264 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f6ef691b-7a6a-489e-9c52-4e79f621fcb1 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:11:11.079486 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.objects.instance [None req-f6ef691b-7a6a-489e-9c52-4e79f621fcb1 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lazy-loading 'services' on Instance uuid f7970ad9-31b5-4946-b689-d7865b3b6462 {{(pid=127565) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 01:11:11.331719 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-f6ef691b-7a6a-489e-9c52-4e79f621fcb1 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] 10.222.0.59 "DELETE /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462/os-volume_attachments/81eb82f7-a18b-48b3-b348-c95f8be953cc" status: 202 len: 0 microversion: 2.1 time: 0.346878 Aug 26 01:11:11.332746 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 591/1187] 10.222.0.59 () {58 vars in 1416 bytes} [Fri Aug 26 01:11:10 2022] DELETE /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462/os-volume_attachments/81eb82f7-a18b-48b3-b348-c95f8be953cc => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 01:11:11.342936 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-9f26dd48-ac64-4f31-8cf7-60d28ce67005 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:11:11.345414 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-9f26dd48-ac64-4f31-8cf7-60d28ce67005 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] [instance: f7970ad9-31b5-4946-b689-d7865b3b6462] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:11:11.352812 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9f26dd48-ac64-4f31-8cf7-60d28ce67005 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:11:11.353235 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9f26dd48-ac64-4f31-8cf7-60d28ce67005 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:11:11.353668 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9f26dd48-ac64-4f31-8cf7-60d28ce67005 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:11:11.354374 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9f26dd48-ac64-4f31-8cf7-60d28ce67005 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:11:11.354990 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9f26dd48-ac64-4f31-8cf7-60d28ce67005 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:11:11.355421 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-9f26dd48-ac64-4f31-8cf7-60d28ce67005 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:11:11.386327 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-9f26dd48-ac64-4f31-8cf7-60d28ce67005 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] 10.222.0.59 "GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048765 Aug 26 01:11:11.387040 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 597/1188] 10.222.0.59 () {58 vars in 1302 bytes} [Fri Aug 26 01:11:11 2022] GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:11:11.990920 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [req-ee8c7364-eb27-4952-9b2f-6cd07c2801c9 req-51ef04eb-7549-4bca-8b11-b9944d0dd70a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7970ad9-31b5-4946-b689-d7865b3b6462", "tag": "a70ffa6d-967c-4bfc-8ada-dab1ddb2116d"}]} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:11:12.001421 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-ee8c7364-eb27-4952-9b2f-6cd07c2801c9 req-51ef04eb-7549-4bca-8b11-b9944d0dd70a service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:11:12.001797 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-ee8c7364-eb27-4952-9b2f-6cd07c2801c9 req-51ef04eb-7549-4bca-8b11-b9944d0dd70a service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:11:12.002225 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-ee8c7364-eb27-4952-9b2f-6cd07c2801c9 req-51ef04eb-7549-4bca-8b11-b9944d0dd70a service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:11:12.013158 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.compute.server_external_events [req-ee8c7364-eb27-4952-9b2f-6cd07c2801c9 req-51ef04eb-7549-4bca-8b11-b9944d0dd70a service nova] Creating event network-changed:a70ffa6d-967c-4bfc-8ada-dab1ddb2116d for instance f7970ad9-31b5-4946-b689-d7865b3b6462 on hv-cinder-83538 Aug 26 01:11:12.017780 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [req-ee8c7364-eb27-4952-9b2f-6cd07c2801c9 req-51ef04eb-7549-4bca-8b11-b9944d0dd70a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030872 Aug 26 01:11:12.018360 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 592/1189] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 01:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:11:12.399569 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-e0efa99b-728e-417c-9dd3-0ac5d4c0ac40 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:11:12.402025 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-e0efa99b-728e-417c-9dd3-0ac5d4c0ac40 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] [instance: f7970ad9-31b5-4946-b689-d7865b3b6462] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:11:12.410863 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e0efa99b-728e-417c-9dd3-0ac5d4c0ac40 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:11:12.411351 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e0efa99b-728e-417c-9dd3-0ac5d4c0ac40 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:11:12.411782 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e0efa99b-728e-417c-9dd3-0ac5d4c0ac40 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:11:12.412667 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e0efa99b-728e-417c-9dd3-0ac5d4c0ac40 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:11:12.413562 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e0efa99b-728e-417c-9dd3-0ac5d4c0ac40 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:11:12.413981 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-e0efa99b-728e-417c-9dd3-0ac5d4c0ac40 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:11:12.445620 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-e0efa99b-728e-417c-9dd3-0ac5d4c0ac40 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] 10.222.0.59 "GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050570 Aug 26 01:11:12.446191 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 598/1190] 10.222.0.59 () {58 vars in 1302 bytes} [Fri Aug 26 01:11:12 2022] GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:11:13.459331 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-4e6ce041-a2f3-4380-ac7d-c6cfd59b8d81 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:11:13.469963 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-4e6ce041-a2f3-4380-ac7d-c6cfd59b8d81 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] [instance: f7970ad9-31b5-4946-b689-d7865b3b6462] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:11:13.469963 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4e6ce041-a2f3-4380-ac7d-c6cfd59b8d81 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:11:13.469963 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4e6ce041-a2f3-4380-ac7d-c6cfd59b8d81 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:11:13.469963 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4e6ce041-a2f3-4380-ac7d-c6cfd59b8d81 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:11:13.470521 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4e6ce041-a2f3-4380-ac7d-c6cfd59b8d81 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:11:13.470521 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4e6ce041-a2f3-4380-ac7d-c6cfd59b8d81 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:11:13.470521 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-4e6ce041-a2f3-4380-ac7d-c6cfd59b8d81 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:11:13.499364 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-4e6ce041-a2f3-4380-ac7d-c6cfd59b8d81 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] 10.222.0.59 "GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045309 Aug 26 01:11:13.499923 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 593/1191] 10.222.0.59 () {58 vars in 1302 bytes} [Fri Aug 26 01:11:13 2022] GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 01:11:13.511801 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-170e5ebc-ef61-4dcb-af7d-d891665f8171 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:11:13.538776 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-170e5ebc-ef61-4dcb-af7d-d891665f8171 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] [instance: f7970ad9-31b5-4946-b689-d7865b3b6462] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:11:13.538776 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-170e5ebc-ef61-4dcb-af7d-d891665f8171 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:11:13.538776 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-170e5ebc-ef61-4dcb-af7d-d891665f8171 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:11:13.538776 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-170e5ebc-ef61-4dcb-af7d-d891665f8171 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:11:13.539271 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-170e5ebc-ef61-4dcb-af7d-d891665f8171 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:11:13.539271 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-170e5ebc-ef61-4dcb-af7d-d891665f8171 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:11:13.539271 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-170e5ebc-ef61-4dcb-af7d-d891665f8171 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:11:13.606738 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.wsgi [None req-170e5ebc-ef61-4dcb-af7d-d891665f8171 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] HTTP exception thrown: Instance f7970ad9-31b5-4946-b689-d7865b3b6462 is not attached to volume 81eb82f7-a18b-48b3-b348-c95f8be953cc Aug 26 01:11:13.609150 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-170e5ebc-ef61-4dcb-af7d-d891665f8171 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Request method failure captured: Aug 26 01:11:13.609150 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: request: DELETE /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462/os-volume_attachments/81eb82f7-a18b-48b3-b348-c95f8be953cc HTTP/1.1 Aug 26 01:11:13.609150 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Accept: application/json Aug 26 01:11:13.609150 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Accept-Encoding: identity Aug 26 01:11:13.609150 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Connection: close Aug 26 01:11:13.609150 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Content-Length: 0 Aug 26 01:11:13.609150 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Content-Type: application/json Aug 26 01:11:13.609150 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Host: 10.222.0.59 Aug 26 01:11:13.609150 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: Openstack-System-Scope: None Aug 26 01:11:13.609150 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: User-Agent: python-urllib3/1.26.11 Aug 26 01:11:13.609150 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Auth-Token: gAAAAABjCB026t5i0d73eAIJp6sLDx93pkQeI0eNdk5X8bD2vTxvmn4kXjv19es7Tj05j44dRfnWKkh8kGINQixLcu_myvpoAaPpRRpxih53fZlFzc4d3CtDhS2fzWAiANTiTPc9czJcUStToNLHWfiZ8WCahudgNeoegWkg3Ghp1Cekzuljgi0 Aug 26 01:11:13.609150 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Domain-Id: None Aug 26 01:11:13.609150 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Domain-Name: None Aug 26 01:11:13.609150 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Identity-Status: Confirmed Aug 26 01:11:13.609150 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Is-Admin-Project: True Aug 26 01:11:13.609150 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Domain-Id: default Aug 26 01:11:13.609150 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Domain-Name: Default Aug 26 01:11:13.609150 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Id: 192b8e73733046a188480d27a9092022 Aug 26 01:11:13.609150 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Project-Name: tempest-TestMinimumBasicScenario-110189959 Aug 26 01:11:13.609150 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Role: reader,member Aug 26 01:11:13.609150 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Roles: reader,member Aug 26 01:11:13.611061 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_192b8e73733046a188480d27a9092022"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/192b8e73733046a188480d27a9092022"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/192b8e73733046a188480d27a9092022"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/192b8e73733046a188480d27a9092022"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 01:11:13.611061 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant: tempest-TestMinimumBasicScenario-110189959 Aug 26 01:11:13.611061 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant-Id: 192b8e73733046a188480d27a9092022 Aug 26 01:11:13.611061 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-Tenant-Name: tempest-TestMinimumBasicScenario-110189959 Aug 26 01:11:13.611061 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User: tempest-TestMinimumBasicScenario-110189959-project Aug 26 01:11:13.611061 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Domain-Id: default Aug 26 01:11:13.611061 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Domain-Name: Default Aug 26 01:11:13.611061 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Id: e811744d2a884e119076cde1b96f4846 Aug 26 01:11:13.611061 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: X-User-Name: tempest-TestMinimumBasicScenario-110189959-project Aug 26 01:11:13.611061 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: method: > Aug 26 01:11:13.611061 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: exception: Instance f7970ad9-31b5-4946-b689-d7865b3b6462 is not attached to volume 81eb82f7-a18b-48b3-b348-c95f8be953cc Aug 26 01:11:13.612139 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: action_args: {'server_id': 'f7970ad9-31b5-4946-b689-d7865b3b6462', 'id': '81eb82f7-a18b-48b3-b348-c95f8be953cc'} Aug 26 01:11:13.612139 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 01:11:13.612139 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:11:13.612139 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 26 01:11:13.612139 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 26 01:11:13.612139 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 26 01:11:13.612139 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 26 01:11:13.612139 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 26 01:11:13.612139 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 26 01:11:13.612139 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 81eb82f7-a18b-48b3-b348-c95f8be953cc. Aug 26 01:11:13.612139 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:11:13.612139 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:11:13.612139 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:11:13.612139 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:11:13.612139 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:11:13.612139 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:11:13.612139 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 01:11:13.612139 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 01:11:13.612139 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 01:11:13.613901 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 01:11:13.613901 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 26 01:11:13.613901 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 26 01:11:13.613901 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7970ad9-31b5-4946-b689-d7865b3b6462 is not attached to volume 81eb82f7-a18b-48b3-b348-c95f8be953cc Aug 26 01:11:13.613901 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:11:13.613901 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:11:13.613901 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:11:13.613901 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:11:13.613901 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:11:13.613901 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:11:13.613901 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 01:11:13.613901 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 01:11:13.613901 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7970ad9-31b5-4946-b689-d7865b3b6462 is not attached to volume 81eb82f7-a18b-48b3-b348-c95f8be953cc Aug 26 01:11:13.613901 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: ERROR nova.api.openstack.wsgi Aug 26 01:11:13.613901 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-170e5ebc-ef61-4dcb-af7d-d891665f8171 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Returning 404 to user: Instance f7970ad9-31b5-4946-b689-d7865b3b6462 is not attached to volume 81eb82f7-a18b-48b3-b348-c95f8be953cc {{(pid=127564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 01:11:13.615295 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-170e5ebc-ef61-4dcb-af7d-d891665f8171 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] 10.222.0.59 "DELETE /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462/os-volume_attachments/81eb82f7-a18b-48b3-b348-c95f8be953cc" status: 404 len: 154 microversion: 2.1 time: 0.103722 Aug 26 01:11:13.615295 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 599/1192] 10.222.0.59 () {58 vars in 1416 bytes} [Fri Aug 26 01:11:13 2022] DELETE /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462/os-volume_attachments/81eb82f7-a18b-48b3-b348-c95f8be953cc => generated 154 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 01:11:14.899571 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-f4a02dc6-097b-4929-a027-67c22a7a744b tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:11:14.900077 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-f4a02dc6-097b-4929-a027-67c22a7a744b tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] [instance: f7970ad9-31b5-4946-b689-d7865b3b6462] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:11:14.906490 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f4a02dc6-097b-4929-a027-67c22a7a744b tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:11:14.906961 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f4a02dc6-097b-4929-a027-67c22a7a744b tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:11:14.907392 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f4a02dc6-097b-4929-a027-67c22a7a744b tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:11:14.908073 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f4a02dc6-097b-4929-a027-67c22a7a744b tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:11:14.908548 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f4a02dc6-097b-4929-a027-67c22a7a744b tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:11:14.908986 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-f4a02dc6-097b-4929-a027-67c22a7a744b tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:11:14.933717 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-f4a02dc6-097b-4929-a027-67c22a7a744b tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] [instance: f7970ad9-31b5-4946-b689-d7865b3b6462] Going to try to terminate instance {{(pid=127565) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 01:11:15.248730 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-f4a02dc6-097b-4929-a027-67c22a7a744b tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] 10.222.0.59 "DELETE /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462" status: 204 len: 0 microversion: 2.1 time: 0.353041 Aug 26 01:11:15.249242 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 594/1193] 10.222.0.59 () {58 vars in 1239 bytes} [Fri Aug 26 01:11:14 2022] DELETE /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 01:11:15.257530 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-aaa484d5-6200-4651-ad60-d09f1a6a56b3 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:11:15.258147 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-aaa484d5-6200-4651-ad60-d09f1a6a56b3 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] [instance: f7970ad9-31b5-4946-b689-d7865b3b6462] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:11:15.264609 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-aaa484d5-6200-4651-ad60-d09f1a6a56b3 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:11:15.266676 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-aaa484d5-6200-4651-ad60-d09f1a6a56b3 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:11:15.266676 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-aaa484d5-6200-4651-ad60-d09f1a6a56b3 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:11:15.266676 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-aaa484d5-6200-4651-ad60-d09f1a6a56b3 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:11:15.266676 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-aaa484d5-6200-4651-ad60-d09f1a6a56b3 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:11:15.267133 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-aaa484d5-6200-4651-ad60-d09f1a6a56b3 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:11:15.398758 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-aaa484d5-6200-4651-ad60-d09f1a6a56b3 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811744d2a884e119076cde1b96f4846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192b8e73733046a188480d27a9092022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:11:15.406563 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-aaa484d5-6200-4651-ad60-d09f1a6a56b3 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] 10.222.0.59 "GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462" status: 200 len: 1554 microversion: 2.1 time: 0.152860 Aug 26 01:11:15.407128 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 600/1194] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:11:15 2022] GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462 => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:11:16.428259 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-5f3cc5df-4acb-4fec-b3c0-7719139a3ade tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:11:16.428907 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-5f3cc5df-4acb-4fec-b3c0-7719139a3ade tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] [instance: f7970ad9-31b5-4946-b689-d7865b3b6462] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:11:16.435411 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5f3cc5df-4acb-4fec-b3c0-7719139a3ade tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:11:16.435903 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5f3cc5df-4acb-4fec-b3c0-7719139a3ade tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:11:16.436327 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5f3cc5df-4acb-4fec-b3c0-7719139a3ade tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:11:16.437495 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5f3cc5df-4acb-4fec-b3c0-7719139a3ade tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:11:16.437495 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5f3cc5df-4acb-4fec-b3c0-7719139a3ade tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:11:16.437888 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-5f3cc5df-4acb-4fec-b3c0-7719139a3ade tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:11:16.565337 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.policy [None req-5f3cc5df-4acb-4fec-b3c0-7719139a3ade tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811744d2a884e119076cde1b96f4846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192b8e73733046a188480d27a9092022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127565) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:11:16.573237 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-5f3cc5df-4acb-4fec-b3c0-7719139a3ade tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] 10.222.0.59 "GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462" status: 200 len: 1554 microversion: 2.1 time: 0.149317 Aug 26 01:11:16.573793 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 595/1195] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:11:16 2022] GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462 => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:11:17.594530 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-53a59b2d-b027-4180-a79d-514646762d90 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:11:17.595127 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-53a59b2d-b027-4180-a79d-514646762d90 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] [instance: f7970ad9-31b5-4946-b689-d7865b3b6462] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:11:17.602820 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-53a59b2d-b027-4180-a79d-514646762d90 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:11:17.603396 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-53a59b2d-b027-4180-a79d-514646762d90 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:11:17.603834 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-53a59b2d-b027-4180-a79d-514646762d90 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:11:17.604552 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-53a59b2d-b027-4180-a79d-514646762d90 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:11:17.605006 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-53a59b2d-b027-4180-a79d-514646762d90 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:11:17.605433 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-53a59b2d-b027-4180-a79d-514646762d90 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:11:17.748504 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-53a59b2d-b027-4180-a79d-514646762d90 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811744d2a884e119076cde1b96f4846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192b8e73733046a188480d27a9092022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:11:17.756896 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-53a59b2d-b027-4180-a79d-514646762d90 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] 10.222.0.59 "GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462" status: 200 len: 1554 microversion: 2.1 time: 0.166245 Aug 26 01:11:17.760252 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 601/1196] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:11:17 2022] GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462 => generated 1554 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:11:17.844355 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [req-0a3a67f6-5f31-4b2b-a3f5-2264f5e7ade1 req-97dbe533-3303-4ef7-8c73-7511e62aca0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7970ad9-31b5-4946-b689-d7865b3b6462", "name": "network-vif-deleted", "tag": "a70ffa6d-967c-4bfc-8ada-dab1ddb2116d"}]} {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 01:11:17.857607 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-0a3a67f6-5f31-4b2b-a3f5-2264f5e7ade1 req-97dbe533-3303-4ef7-8c73-7511e62aca0c service nova] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:11:17.857607 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-0a3a67f6-5f31-4b2b-a3f5-2264f5e7ade1 req-97dbe533-3303-4ef7-8c73-7511e62aca0c service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:11:17.857607 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [req-0a3a67f6-5f31-4b2b-a3f5-2264f5e7ade1 req-97dbe533-3303-4ef7-8c73-7511e62aca0c service nova] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:11:17.869042 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.compute.server_external_events [req-0a3a67f6-5f31-4b2b-a3f5-2264f5e7ade1 req-97dbe533-3303-4ef7-8c73-7511e62aca0c service nova] Creating event network-vif-deleted:a70ffa6d-967c-4bfc-8ada-dab1ddb2116d for instance f7970ad9-31b5-4946-b689-d7865b3b6462 on hv-cinder-83538 Aug 26 01:11:17.873751 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [req-0a3a67f6-5f31-4b2b-a3f5-2264f5e7ade1 req-97dbe533-3303-4ef7-8c73-7511e62aca0c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033464 Aug 26 01:11:17.874336 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 596/1197] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Aug 26 01:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 01:11:18.777836 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-bb24f8d2-ef99-4f47-b411-28fea28775e2 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Calling method '>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:11:18.778441 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.compute.api [None req-bb24f8d2-ef99-4f47-b411-28fea28775e2 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] [instance: f7970ad9-31b5-4946-b689-d7865b3b6462] Fetching instance by UUID {{(pid=127564) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:11:18.784822 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bb24f8d2-ef99-4f47-b411-28fea28775e2 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:11:18.785298 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bb24f8d2-ef99-4f47-b411-28fea28775e2 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:11:18.785797 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bb24f8d2-ef99-4f47-b411-28fea28775e2 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:11:18.786528 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bb24f8d2-ef99-4f47-b411-28fea28775e2 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:11:18.786969 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bb24f8d2-ef99-4f47-b411-28fea28775e2 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:11:18.787387 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bb24f8d2-ef99-4f47-b411-28fea28775e2 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:11:18.819512 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bb24f8d2-ef99-4f47-b411-28fea28775e2 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:11:18.819986 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bb24f8d2-ef99-4f47-b411-28fea28775e2 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:11:18.820422 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG oslo_concurrency.lockutils [None req-bb24f8d2-ef99-4f47-b411-28fea28775e2 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:11:18.820907 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.objects.instance [None req-bb24f8d2-ef99-4f47-b411-28fea28775e2 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lazy-loading 'fault' on Instance uuid f7970ad9-31b5-4946-b689-d7865b3b6462 {{(pid=127564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 01:11:18.861245 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.policy [None req-bb24f8d2-ef99-4f47-b411-28fea28775e2 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e811744d2a884e119076cde1b96f4846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192b8e73733046a188480d27a9092022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127564) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 01:11:18.869517 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-bb24f8d2-ef99-4f47-b411-28fea28775e2 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] 10.222.0.59 "GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462" status: 200 len: 1348 microversion: 2.1 time: 0.095556 Aug 26 01:11:18.870076 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 602/1198] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:11:18 2022] GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462 => generated 1348 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 01:11:19.892894 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-3eea8c34-50c0-4a82-b153-16d72be2b05a tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Calling method '>' {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:11:19.893605 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.compute.api [None req-3eea8c34-50c0-4a82-b153-16d72be2b05a tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] [instance: f7970ad9-31b5-4946-b689-d7865b3b6462] Fetching instance by UUID {{(pid=127565) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 01:11:19.900028 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3eea8c34-50c0-4a82-b153-16d72be2b05a tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:11:19.900540 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3eea8c34-50c0-4a82-b153-16d72be2b05a tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:11:19.900982 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3eea8c34-50c0-4a82-b153-16d72be2b05a tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:11:19.901667 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3eea8c34-50c0-4a82-b153-16d72be2b05a tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Acquiring lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 01:11:19.902121 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3eea8c34-50c0-4a82-b153-16d72be2b05a tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 01:11:19.902542 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG oslo_concurrency.lockutils [None req-3eea8c34-50c0-4a82-b153-16d72be2b05a tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Lock "4dc4ae0c-6c1f-4730-b3bf-2d96dca9329a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 01:11:19.916539 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.wsgi [None req-3eea8c34-50c0-4a82-b153-16d72be2b05a tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] HTTP exception thrown: Instance f7970ad9-31b5-4946-b689-d7865b3b6462 could not be found. Aug 26 01:11:19.918160 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-3eea8c34-50c0-4a82-b153-16d72be2b05a tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Request method failure captured: Aug 26 01:11:19.918160 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: request: GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462 HTTP/1.1 Aug 26 01:11:19.918160 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Accept: application/json Aug 26 01:11:19.918160 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Accept-Encoding: identity Aug 26 01:11:19.918160 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Connection: close Aug 26 01:11:19.918160 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Content-Length: 0 Aug 26 01:11:19.918160 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Content-Type: application/json Aug 26 01:11:19.918160 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Host: 10.222.0.59 Aug 26 01:11:19.918160 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: Openstack-System-Scope: None Aug 26 01:11:19.918160 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: User-Agent: python-urllib3/1.26.11 Aug 26 01:11:19.918160 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Auth-Token: gAAAAABjCB026t5i0d73eAIJp6sLDx93pkQeI0eNdk5X8bD2vTxvmn4kXjv19es7Tj05j44dRfnWKkh8kGINQixLcu_myvpoAaPpRRpxih53fZlFzc4d3CtDhS2fzWAiANTiTPc9czJcUStToNLHWfiZ8WCahudgNeoegWkg3Ghp1Cekzuljgi0 Aug 26 01:11:19.918160 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Domain-Id: None Aug 26 01:11:19.918160 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Domain-Name: None Aug 26 01:11:19.918160 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Identity-Status: Confirmed Aug 26 01:11:19.918160 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Is-Admin-Project: True Aug 26 01:11:19.918160 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Domain-Id: default Aug 26 01:11:19.918160 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Domain-Name: Default Aug 26 01:11:19.918160 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Id: 192b8e73733046a188480d27a9092022 Aug 26 01:11:19.918160 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Project-Name: tempest-TestMinimumBasicScenario-110189959 Aug 26 01:11:19.918160 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Role: reader,member Aug 26 01:11:19.918160 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Roles: reader,member Aug 26 01:11:19.919917 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_192b8e73733046a188480d27a9092022"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/192b8e73733046a188480d27a9092022"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/192b8e73733046a188480d27a9092022"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/192b8e73733046a188480d27a9092022"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}] Aug 26 01:11:19.919917 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant: tempest-TestMinimumBasicScenario-110189959 Aug 26 01:11:19.919917 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant-Id: 192b8e73733046a188480d27a9092022 Aug 26 01:11:19.919917 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-Tenant-Name: tempest-TestMinimumBasicScenario-110189959 Aug 26 01:11:19.919917 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User: tempest-TestMinimumBasicScenario-110189959-project Aug 26 01:11:19.919917 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Domain-Id: default Aug 26 01:11:19.919917 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Domain-Name: Default Aug 26 01:11:19.919917 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Id: e811744d2a884e119076cde1b96f4846 Aug 26 01:11:19.919917 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: X-User-Name: tempest-TestMinimumBasicScenario-110189959-project Aug 26 01:11:19.919917 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: method: > Aug 26 01:11:19.919917 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: exception: Instance f7970ad9-31b5-4946-b689-d7865b3b6462 could not be found. Aug 26 01:11:19.919917 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: action_args: {'id': 'f7970ad9-31b5-4946-b689-d7865b3b6462'} Aug 26 01:11:19.921027 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: {{(pid=127565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 01:11:19.921027 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:11:19.921027 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 01:11:19.921027 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 01:11:19.921027 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 01:11:19.921027 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 01:11:19.921027 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 01:11:19.921027 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 01:11:19.921027 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 01:11:19.921027 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 01:11:19.921027 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7970ad9-31b5-4946-b689-d7865b3b6462 could not be found. Aug 26 01:11:19.921027 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:11:19.921027 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:11:19.921027 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:11:19.921027 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:11:19.921027 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:11:19.921027 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:11:19.921027 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 01:11:19.921027 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 01:11:19.921027 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 01:11:19.922829 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 01:11:19.922829 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 01:11:19.922829 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 01:11:19.922829 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 01:11:19.922829 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 01:11:19.922829 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 01:11:19.922829 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 01:11:19.922829 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7970ad9-31b5-4946-b689-d7865b3b6462 could not be found. Aug 26 01:11:19.922829 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:11:19.922829 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 01:11:19.922829 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:11:19.922829 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 01:11:19.922829 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 01:11:19.922829 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 01:11:19.922829 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 01:11:19.922829 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 01:11:19.922829 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7970ad9-31b5-4946-b689-d7865b3b6462 could not be found. Aug 26 01:11:19.922829 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: ERROR nova.api.openstack.wsgi Aug 26 01:11:19.924673 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: DEBUG nova.api.openstack.wsgi [None req-3eea8c34-50c0-4a82-b153-16d72be2b05a tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Returning 404 to user: Instance f7970ad9-31b5-4946-b689-d7865b3b6462 could not be found. {{(pid=127565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 01:11:19.924673 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: INFO nova.api.openstack.requestlog [None req-3eea8c34-50c0-4a82-b153-16d72be2b05a tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] 10.222.0.59 "GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462" status: 404 len: 111 microversion: 2.1 time: 0.031490 Aug 26 01:11:19.924673 dv-cinder-835384-25-iscsi devstack@n-api.service[127565]: [pid: 127565|app: 0|req: 597/1199] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Aug 26 01:11:19 2022] GET /compute/v2.1/servers/f7970ad9-31b5-4946-b689-d7865b3b6462 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 01:11:19.928273 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: DEBUG nova.api.openstack.wsgi [None req-166434ef-68a7-463a-8b6a-ced3e939b704 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] Calling method '.version_select at 0x7f8a92e15430>' {{(pid=127564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 01:11:20.035500 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: INFO nova.api.openstack.requestlog [None req-166434ef-68a7-463a-8b6a-ced3e939b704 tempest-TestMinimumBasicScenario-110189959 tempest-TestMinimumBasicScenario-110189959-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-150683346" status: 202 len: 0 microversion: 2.1 time: 0.110925 Aug 26 01:11:20.036076 dv-cinder-835384-25-iscsi devstack@n-api.service[127564]: [pid: 127564|app: 0|req: 603/1200] 10.222.0.59 () {58 vars in 1269 bytes} [Fri Aug 26 01:11:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-150683346 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0)